00000001:02000400:3.0F:1789596501.786586:0:2959:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg244-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1789596519.654269:0:3184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg244-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1789596522.034992:0:3246:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 375 MB/s 00000001:01000000:1.0F:1789596522.285568:0:3246:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 571 MB/s 00000001:01000000:3.0:1789596522.535112:0:3246:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2951 MB/s 00000020:02000000:1.0:1789596523.220444:0:3275:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g6aa67ea 00000400:02000000:0.0F:1789596524.311490:0:3290:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.144@tcp [8/256/0/180] 00008000:02000000:0.0:1789596528.564185:0:3440:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1789596577.309738:0:5246:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg244-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789596587.665227:0:5822:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789596587.665233:0:5822:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789596587.665377:0:5822:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ec172519 00000080:02000400:1.0:1789596587.665388:0:5822:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789596587.669554:0:5822:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789596587.669567:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789596587.669605:0:5822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000455c97ed) 00000020:00000080:1.0:1789596587.669624:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789596587.694583:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789596587.695214:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789596587.726266:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1789596587.726305:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789596587.726325:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1789596587.726377:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789596587.726401:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1789596587.726775:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789596587.726784:0:5822:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789596587.726797:0:5822:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8973ae90b38d762a 00000020:01000004:0.0:1789596587.726804:0:5822:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1789596587.726809:0:5822:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789596587.726814:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ec172519 from MGS 00000020:01000004:0.0:1789596587.726844:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789596587.729256:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000843f13f0) 00000020:00000080:3.0:1789596587.735665:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789596587.736039:0:5822:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ec172519 from MGS, refs=2 00080000:01000000:3.0:1789596587.736051:0:5822:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789596587.736058:0:5822:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8973ae90b38d7638 00000100:00100000:3.0:1789596587.736209:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789596587.736348:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789596587.736355:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789596587.749058:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789596587.749085:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789596587.758420:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789596587.760099:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789596587.760108:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789596587.764419:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789596587.764434:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789596587.765109:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789596587.765118:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789596587.765663:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596587.765667:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596587.765668:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596587.770168:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596587.770175:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596587.770177:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596587.771255:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789596587.772963:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789596588.022039:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1816 MB/s 00000001:01000000:3.0:1789596588.272018:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2427 MB/s 00000001:01000000:2.0:1789596588.522112:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 391 MB/s 00000001:01000000:2.0:1789596588.771960:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 611 MB/s 00080000:10000000:2.0:1789596588.794675:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1789596588.810048:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789596588.810065:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789596588.810067:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789596588.823247:0:5822:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789596588.823407:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789596588.823650:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789596588.823681:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789596588.824071:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789596588.824240:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789596588.824246:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 10000000:01000000:3.0:1789596588.826196:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 00000100:00100000:3.0:1789596588.829290:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789596588.829311:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00010000:00010000:2.0:1789596588.830287:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596588.835332:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789596588.835387:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789596588.836169:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789596588.836189:0:5822:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.144@tcp' 00000020:01000004:2.0:1789596588.836191:0:5822:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789596588.836241:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.144@tcp (typ=mgc) 00000020:00000080:2.0:1789596588.836260:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.144@tcp (0000000093e68819) 00000020:00000080:2.0:1789596588.836276:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:0.0:1789596588.836297:0:5837:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:2.0:1789596588.836389:0:5822:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000031ad70fa@MGC192.168.202.144@tcp: add connection 192.168.202.144@tcp at head 00010000:00010000:2.0:1789596588.836553:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.144@tcp-0 is initialized 00000040:01000000:2.0:1789596588.836559:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.144@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789596588.844225:0:5838:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789596588.844398:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.144@tcp (uuid d7810da1-eaae-414b-ba87-f9d6f005a55b) 00000020:00000080:3.0:1789596588.844423:0:5822:0:(genops.c:1384:class_connect()) connect: client d7810da1-eaae-414b-ba87-f9d6f005a55b, cookie 0x8973ae90b38d7646 00000100:00080000:3.0:1789596588.844435:0:5822:0:(import.c:545:import_select_connection()) MGC192.168.202.144@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789596588.844443:0:5822:0:(import.c:666:import_select_connection()) MGC192.168.202.144@tcp: import 0000000031ad70fa using connection 192.168.202.144@tcp/0@lo 00000100:00100000:3.0:1789596588.844489:0:5822:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000eda06f4c x1876527964749952/t0(0) o250->MGC192.168.202.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789596588.844514:0:5822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d7810da1-eaae-414b-ba87-f9d6f005a55b->MGS 00000100:00100000:2.0:1789596588.847427:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eda06f4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d7810da1-eaae-414b-ba87-f9d6f005a55b:3305:1876527964749952:0@lo:250: 00000100:00100000:2.0:1789596588.847513:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1789596588.847667:0:5822:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000100:00100000:3.0:1789596588.848052:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964749952 00000100:00100000:3.0:1789596588.848062:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964749952 00000100:00100000:3.0:1789596588.848093:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789596588.848099:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a249b2ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1876527964749952:12345-0@lo:250: 00010000:00080000:3.0:1789596588.848135:0:5834:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from d7810da1-eaae-414b-ba87-f9d6f005a55b@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:3.0:1789596588.848160:0:5834:0:(genops.c:1384:class_connect()) connect: client d7810da1-eaae-414b-ba87-f9d6f005a55b, cookie 0x8973ae90b38d764d 00000100:00080000:3.0:1789596588.848289:0:5834:0:(import.c:65:import_set_state_nolock()) 0000000036c73968 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789596588.848360:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a249b2ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+5:3305:x1876527964749952:12345-0@lo:250: Request processed in 260us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596588.848367:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789596588.848455:0:3305:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.144@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789596588.848464:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.144@tcp: connect to target with instance 0 00000100:00080000:2.0:1789596588.848471:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.144@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789596588.848475:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789596588.848483:0:3305:0:(import.c:65:import_set_state_nolock()) 0000000031ad70fa MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789596588.848485:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789596588.848495:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789596588.848499:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eda06f4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d7810da1-eaae-414b-ba87-f9d6f005a55b:3305:1876527964749952:0@lo:250: 00000020:01000004:2.0:1789596588.848523:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789596588.848536:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000de62ece5) 00000020:00000080:2.0:1789596588.848545:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789596588.859379:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789596588.859570:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789596588.859576:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789596588.863269:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789596588.863281:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789596588.863612:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789596588.863619:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789596588.864424:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789596588.864588:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789596588.864602:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789596588.865436:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789596588.865444:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789596588.909143:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789596588.909355:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789596588.909361:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789596588.910362:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789596588.910372:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789596588.911302:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789596588.911460:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789596588.911466:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789596588.911894:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789596588.911901:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789596588.912541:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789596588.912699:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789596588.912705:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789596588.913244:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789596588.913251:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789596588.913774:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789596588.914089:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789596588.914103:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789596588.914516:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789596588.914532:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789596588.940486:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789596588.940691:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789596588.940697:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789596588.943435:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789596588.943452:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789596588.945254:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789596588.945276:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789596588.945951:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789596588.945974:0:5822:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789596588.945981:0:5822:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.144@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789596588.946102:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.144@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789596588.946145:0:5822:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.144@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789596588.946149:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789596588.946151:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789596588.946153:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596588.946154:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789596588.946155:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596588.946156:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596588.946158:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789596588.946159:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789596588.946160:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789596588.946162:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789596588.946163:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596588.946164:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789596588.946167:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789596588.946169:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789596588.946170:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789596588.946171:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596588.946172:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789596588.946173:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596588.946174:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596588.946175:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789596588.946175:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789596588.946176:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789596588.946177:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789596588.946178:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596588.946179:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789596588.946215:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789596588.946232:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029315dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964750080:0@lo:253: 00000100:00100000:2.0:1789596588.946443:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596588.946547:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 0000000062828e0f going to sleep for 11 seconds 00000100:00100000:3.0:1789596588.946587:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964750080 00000100:00100000:3.0:1789596588.946595:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964750080 00000100:00100000:3.0:1789596588.946686:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789596588.946695:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000071a3264e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+5:5822:x1876527964750080:12345-0@lo:253: 20000000:01000000:3.0:1789596588.946786:0:5836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789596588.946789:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1789596588.949100:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789596588.949178:0:5836:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1789596588.949416:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789596588.952392:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1789596588.952689:0:5836:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789596588.952694:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1789596588.952699:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1789596588.952702:0:5836:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1789596588.952725:0:5836:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1789596588.952987:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789596588.953225:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1789596588.953239:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789596588.953285:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1789596588.953354:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1789596588.953388:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1789596588.953462:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1789596588.953469:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1789596588.953507:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1789596588.953514:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1789596588.953541:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1789596588.953547:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1789596588.953568:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1789596588.953616:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1789596588.953642:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789596588.953647:0:5836:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1789596588.953658:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789596588.953978:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1789596588.953989:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789596588.954025:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1789596588.954059:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1789596588.954106:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1789596588.954131:0:5836:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1789596588.954206:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1789596588.954214:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789596588.954270:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1789596588.954312:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1789596588.954345:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1789596588.954356:0:5836:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1789596588.954574:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1789596588.954584:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1789596588.954632:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1789596588.954677:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1789596588.957406:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1789596588.957495:0:5836:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789596588.957503:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1789596588.958183:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1789596588.958451:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789596588.958479:0:5836:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.144@tcp for mdt 20000000:01000000:3.0:1789596588.958481:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.144@tcp (null) (null) (null) 00000040:00080000:3.0:1789596588.958519:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789596588.958527:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789596588.958556:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789596588.958564:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.144@tcp (null) (null) 00000040:00080000:3.0:1789596588.958610:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789596588.958619:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789596588.958646:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789596588.958673:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789596588.958748:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789596588.958751:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789596588.958757:0:5836:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789596588.958763:0:5836:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789596588.959576:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1789596588.959710:0:5836:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789596588.968640:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789596588.968694:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1789596588.968799:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1789596588.968845:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789596588.968848:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789596588.968852:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789596588.968865:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789596588.968867:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789596588.968898:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789596588.968901:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789596588.969956:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789596588.970441:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789596588.970492:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789596588.970525:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1789596588.970539:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789596588.970542:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789596588.970962:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1789596588.971453:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1789596588.971497:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1789596588.971546:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:2.0:1789596588.971559:0:5836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789596588.971561:0:5836:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1789596588.971567:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789596588.971584:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009cd9a410/0x8973ae90b38d765b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596588.971599:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009cd9a410/0x8973ae90b38d765b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596588.971608:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009cd9a410/0x8973ae90b38d765b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596588.971614:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009cd9a410/0x8973ae90b38d765b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596588.971620:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009cd9a410/0x8973ae90b38d765b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596588.971626:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009cd9a410/0x8973ae90b38d765b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596588.971631:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009cd9a410 already unused, calling callback (00000000ed09425e) 00010000:00010000:2.0:1789596588.971642:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009cd9a410/0x8973ae90b38d765b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596588.971650:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009cd9a410/0x8973ae90b38d765b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596588.971661:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009cd9a410/0x8973ae90b38d765b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596588.971668:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009cd9a410/0x8973ae90b38d765b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596588.971673:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009cd9a410/0x8973ae90b38d765b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789596588.971689:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789596589.233099:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000071a3264e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+5:5822:x1876527964750080:12345-0@lo:253: Request processed in 286399us (286649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596589.233128:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789596589.233238:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029315dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964750080:0@lo:253: 10000000:01000000:2.0:1789596589.233253:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789596589.233256:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789596589.233259:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789596589.233260:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596589.233261:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789596589.233262:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596589.233263:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596589.233264:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789596589.233266:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789596589.233267:0:5822:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789596589.233268:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596589.233269:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789596589.233291:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ec172519 from lustre-MDT0000 10000000:01000000:2.0:1789596589.233313:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789596589.233316:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789596589.233320:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ea8c2ca3380 10000000:01000000:2.0:1789596589.233323:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789596589.233345:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ea8c2ca3380 from 1 10000000:01000000:2.0:1789596589.233348:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789596589.233400:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: 000000009cd9a410/0x8973ae90b38d7662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.233411:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: 000000009cd9a410/0x8973ae90b38d7662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.233420:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: 000000009cd9a410/0x8973ae90b38d7662 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596589.233437:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029315dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964750208:0@lo:101: 00000100:00100000:2.0:1789596589.233470:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596589.233534:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000953243b1 going to sleep for 11 seconds 00000100:00100000:3.0:1789596589.233716:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964750208 00000100:00100000:3.0:1789596589.233723:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964750208 00000100:00100000:3.0:1789596589.233765:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789596589.233782:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b101ac10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+5:5822:x1876527964750208:12345-0@lo:101: 00010000:00010000:3.0:1789596589.233793:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596589.233844:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e6595b86/0x8973ae90b38d7669 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d7662 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596589.233865:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e6595b86/0x8973ae90b38d7669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d7662 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596589.233875:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e6595b86/0x8973ae90b38d7669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7662 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596589.233882:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e6595b86, rc 0) 00000100:00100000:3.0:1789596589.233918:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b101ac10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+6:5822:x1876527964750208:12345-0@lo:101: Request processed in 138us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596589.233925:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789596589.235318:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029315dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964750208:0@lo:101: 00010000:00010000:2.0:1789596589.235340:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: 000000009cd9a410/0x8973ae90b38d7662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7669 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.235351:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: 000000009cd9a410/0x8973ae90b38d7662 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7669 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596589.235426:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029315dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964750336:0@lo:501: 00000100:00100000:2.0:1789596589.235471:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596589.235511:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000953243b1 going to sleep for 11 seconds 00000100:00100000:1.0:1789596589.235587:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964750336 00000100:00100000:1.0:1789596589.235594:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964750336 00000100:00100000:1.0:1789596589.235637:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789596589.235644:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c910650 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+6:5822:x1876527964750336:12345-0@lo:501: 00000100:00100000:0.0:1789596589.236181:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c910650 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+6:5822:x1876527964750336:12345-0@lo:501: Request processed in 535us (707us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789596589.236202:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789596589.237455:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029315dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964750336:0@lo:501: 10000000:01000000:2.0:1789596589.237491:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789596589.237511:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: 000000009cd9a410/0x8973ae90b38d7662 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7669 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.237536:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: 000000009cd9a410/0x8973ae90b38d7662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7669 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596589.237545:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ea8e4942800 10000000:01000000:2.0:1789596589.237549:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789596589.237553:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ea8e4942800 10000000:01000000:2.0:1789596589.237556:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789596589.237559:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ea8e4942800 from 1 10000000:01000000:2.0:1789596589.237561:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789596589.237588:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: 000000003962a8cd/0x8973ae90b38d7670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.237595:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: 000000003962a8cd/0x8973ae90b38d7670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.237604:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: 000000003962a8cd/0x8973ae90b38d7670 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596589.237619:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029315dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964750464:0@lo:101: 00000100:00100000:2.0:1789596589.237657:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596589.237693:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000953243b1 going to sleep for 11 seconds 00000100:00100000:3.0:1789596589.237711:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964750464 00000100:00100000:3.0:1789596589.237717:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964750464 00000100:00100000:3.0:1789596589.237760:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789596589.237767:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bf70c391 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+6:5822:x1876527964750464:12345-0@lo:101: 00010000:00010000:3.0:1789596589.237778:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596589.237789:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d8bed264/0x8973ae90b38d7677 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d7670 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596589.237848:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d8bed264/0x8973ae90b38d7677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d7670 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596589.237858:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d8bed264/0x8973ae90b38d7677 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7670 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596589.237866:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d8bed264, rc 0) 00000100:00100000:3.0:1789596589.237909:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bf70c391 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+7:5822:x1876527964750464:12345-0@lo:101: Request processed in 143us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596589.237915:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789596589.237940:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029315dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964750464:0@lo:101: 00010000:00010000:2.0:1789596589.237951:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: 000000003962a8cd/0x8973ae90b38d7670 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7677 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.237958:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: 000000003962a8cd/0x8973ae90b38d7670 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7677 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596589.237982:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789596589.237999:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: 000000003962a8cd/0x8973ae90b38d7670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7677 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.238005:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: 000000003962a8cd/0x8973ae90b38d7670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7677 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596589.238010:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789596589.238013:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789596589.238017:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ea8e4942800 10000000:01000000:2.0:1789596589.238019:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789596589.238022:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789596589.238024:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789596589.238037:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: 00000000476cb42e/0x8973ae90b38d767e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.238043:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: 00000000476cb42e/0x8973ae90b38d767e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.238049:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: 00000000476cb42e/0x8973ae90b38d767e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596589.238059:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029315dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964750592:0@lo:101: 00000100:00100000:2.0:1789596589.238081:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596589.238106:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000953243b1 going to sleep for 11 seconds 00000100:00100000:1.0:1789596589.238217:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964750592 00000100:00100000:1.0:1789596589.238221:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964750592 00000100:00100000:1.0:1789596589.238252:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789596589.238259:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000073193fdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+7:5822:x1876527964750592:12345-0@lo:101: 00010000:00010000:1.0:1789596589.238265:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596589.238273:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004d2cde5d/0x8973ae90b38d7685 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d767e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596589.238286:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004d2cde5d/0x8973ae90b38d7685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d767e expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596589.238301:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004d2cde5d/0x8973ae90b38d7685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d767e expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596589.238308:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004d2cde5d, rc 0) 00000100:00100000:1.0:1789596589.238343:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000073193fdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+8:5822:x1876527964750592:12345-0@lo:101: Request processed in 85us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596589.238348:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789596589.238536:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029315dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964750592:0@lo:101: 00010000:00010000:2.0:1789596589.238546:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: 00000000476cb42e/0x8973ae90b38d767e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7685 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.238562:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: 00000000476cb42e/0x8973ae90b38d767e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7685 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596589.238603:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029315dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964750720:0@lo:501: 00000100:00100000:2.0:1789596589.238626:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596589.238648:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000953243b1 going to sleep for 11 seconds 00000100:00100000:3.0:1789596589.238760:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964750720 00000100:00100000:3.0:1789596589.238765:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964750720 00000100:00100000:3.0:1789596589.238795:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789596589.238803:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000df09af0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+8:5822:x1876527964750720:12345-0@lo:501: 00000100:00100000:3.0:1789596589.239050:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000df09af0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+9:5822:x1876527964750720:12345-0@lo:501: Request processed in 249us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596589.239057:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789596589.239146:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029315dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964750720:0@lo:501: 00000100:00100000:2.0:1789596589.239174:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029315dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964750848:0@lo:503: 00000100:00100000:2.0:1789596589.239209:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596589.239247:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000953243b1 going to sleep for 11 seconds 00000100:00100000:0.0:1789596589.239306:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964750848 00000100:00100000:0.0:1789596589.239311:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964750848 00000100:00100000:0.0:1789596589.239365:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789596589.239373:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002fc117d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+9:5822:x1876527964750848:12345-0@lo:503: 00000100:00100000:0.0:1789596589.239520:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002fc117d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+9:5822:x1876527964750848:12345-0@lo:503: Request processed in 148us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596589.239527:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789596589.239702:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029315dc4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964750848:0@lo:503: 00000100:00100000:2.0:1789596589.240066:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029315dc4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:5864:1876527964750976:0@lo:502: 00000100:00100000:2.0:1789596589.240102:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596589.240137:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a46327f2 going to sleep for 11 seconds 00000100:00100000:0.0:1789596589.240188:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964750976 00000100:00100000:0.0:1789596589.240193:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964750976 00000100:00100000:0.0:1789596589.240223:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789596589.240229:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001168653a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+9:5864:x1876527964750976:12345-0@lo:502: 00000100:00100000:0.0:1789596589.240377:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001168653a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+9:5864:x1876527964750976:12345-0@lo:502: Request processed in 148us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596589.240384:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789596589.240516:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029315dc4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:5864:1876527964750976:0@lo:502: 00000020:01000000:2.0:1789596589.240539:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596589.240549:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596589.240551:0:5864:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789596589.240556:0:5864:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789596589.240559:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789596589.240573:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000171d63ad) 00000020:00000080:2.0:1789596589.240589:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789596589.240594:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789596589.240671:0:5864:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789596589.240678:0:5864:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8973ae90b38d7693 00000020:00000080:2.0:1789596589.240914:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789596589.240924:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596589.240927:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596589.240929:0:5864:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789596589.240931:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596589.240935:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596589.240936:0:5864:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789596589.240939:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789596589.240945:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000004567c1db) 00000020:00000080:2.0:1789596589.240956:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789596589.240959:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789596589.240961:0:5864:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789596589.240964:0:5864:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789596589.240970:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789596589.241017:0:5864:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ec172519 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789596589.241036:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000008154a53b) 00000020:00000080:2.0:1789596589.241044:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789596589.241096:0:5864:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789596589.241102:0:5864:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8973ae90b38d76a8 00000020:00000080:2.0:1789596589.241216:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789596589.241223:0:5864:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789596589.241228:0:5864:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8973ae90b38d76af 00080000:01000000:2.0:1789596589.241233:0:5864:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789596589.241237:0:5864:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8973ae90b38d76b6 00080000:10000000:2.0:1789596589.241742:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1789596589.244165:0:5864:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789596589.262495:0:5864:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789596589.410767:0:5864:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789596589.411095:0:5864:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789596589.415074:0:5864:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789596589.415508:0:5864:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789596589.493573:0:5864:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000005f33d974) 00000020:00000080:3.0:1789596589.493608:0:5864:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789596589.493674:0:5864:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789596589.493681:0:5864:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8973ae90b38d76c4 00000020:00000080:3.0:1789596589.508335:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789596589.510095:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789596589.561655:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789596589.639167:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789596589.674696:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789596589.745056:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789596589.783658:0:5864:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1789596589.825278:0:5864:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8973ae90b38d76cb 00000020:00000080:2.0:1789596589.825724:0:5864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789596589.825735:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596589.825741:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596589.825743:0:5864:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789596589.825745:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596589.825751:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596589.825752:0:5864:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789596589.825756:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789596589.825797:0:5864:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789596589.825809:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596589.825812:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596589.825907:0:5864:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789596589.825911:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596589.825916:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596589.825917:0:5864:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789596589.825920:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789596589.825922:0:5864:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789596589.825964:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029315dc4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:5864:1876527964751104:0@lo:502: 00000100:00100000:2.0:1789596589.826032:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596589.826081:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a46327f2 going to sleep for 11 seconds 00000100:00100000:3.0:1789596589.826154:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964751104 00000100:00100000:3.0:1789596589.826162:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964751104 00000100:00100000:3.0:1789596589.826209:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789596589.826217:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c5ccfc8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+9:5864:x1876527964751104:12345-0@lo:502: 00000100:00100000:3.0:1789596589.826511:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c5ccfc8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+9:5864:x1876527964751104:12345-0@lo:502: Request processed in 295us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596589.826519:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789596589.826571:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029315dc4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:5864:1876527964751104:0@lo:502: 00000020:01000000:3.0:1789596589.826596:0:5864:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596589.826601:0:5864:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596589.826603:0:5864:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789596589.826606:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1789596589.827119:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1789596589.827136:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789596589.827241:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: 00000000476cb42e/0x8973ae90b38d767e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7685 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596589.827251:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: 00000000476cb42e/0x8973ae90b38d767e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7685 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596589.827258:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ea8e4942800 from 1 10000000:01000000:3.0:1789596589.827261:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789596589.827290:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: 00000000db106471/0x8973ae90b38d76d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596589.827297:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: 00000000db106471/0x8973ae90b38d76d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596589.827306:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: 00000000db106471/0x8973ae90b38d76d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596589.827318:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000066a5de73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964751232:0@lo:101: 00000100:00100000:3.0:1789596589.827350:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596589.827386:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000431144f3 going to sleep for 11 seconds 00000100:00100000:2.0:1789596589.827440:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964751232 00000100:00100000:2.0:1789596589.827445:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964751232 00000100:00100000:2.0:1789596589.827475:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789596589.827480:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001ffb9ee6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+9:5822:x1876527964751232:12345-0@lo:101: 00010000:00010000:2.0:1789596589.827490:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596589.827501:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c1486d5a/0x8973ae90b38d76d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d76d2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.827519:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c1486d5a/0x8973ae90b38d76d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d76d2 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.827528:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c1486d5a/0x8973ae90b38d76d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d76d2 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.827535:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c1486d5a, rc 0) 00000100:00100000:2.0:1789596589.827563:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001ffb9ee6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+10:5822:x1876527964751232:12345-0@lo:101: Request processed in 83us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596589.827569:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789596589.827646:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000066a5de73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964751232:0@lo:101: 00010000:00010000:3.0:1789596589.827657:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: 00000000db106471/0x8973ae90b38d76d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d76d9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596589.827672:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: 00000000db106471/0x8973ae90b38d76d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d76d9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596589.828252:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000066a5de73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964751360:0@lo:256: 00000100:00100000:3.0:1789596589.828287:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596589.828309:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000431144f3 going to sleep for 11 seconds 00000100:00100000:3.0:1789596589.828327:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964751360 00000100:00100000:3.0:1789596589.828331:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964751360 00000100:00100000:3.0:1789596589.828353:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789596589.828358:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b500bb43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+10:5822:x1876527964751360:12345-0@lo:256: 20000000:01000000:3.0:1789596589.828372:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789596589.828378:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789596589.828433:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b500bb43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+10:5822:x1876527964751360:12345-0@lo:256: Request processed in 75us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596589.828440:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789596589.828471:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000066a5de73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964751360:0@lo:256: 10000000:01000000:3.0:1789596589.829066:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789596589.829593:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: 00000000db106471/0x8973ae90b38d76d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d76d9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596589.829604:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: 00000000db106471/0x8973ae90b38d76d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d76d9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596589.829610:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea8e4942800 from 1 10000000:01000000:3.0:1789596589.829612:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789596589.829639:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: 0000000059cbd8c1/0x8973ae90b38d76e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596589.829658:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: 0000000059cbd8c1/0x8973ae90b38d76e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596589.829667:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: 0000000059cbd8c1/0x8973ae90b38d76e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596589.829682:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000066a5de73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964751488:0@lo:101: 00000100:00100000:3.0:1789596589.829717:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596589.829750:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000431144f3 going to sleep for 11 seconds 00000100:00100000:0.0:1789596589.829859:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964751488 00000100:00100000:0.0:1789596589.829865:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964751488 00000100:00100000:0.0:1789596589.829899:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789596589.829907:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000034e16b7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+10:5822:x1876527964751488:12345-0@lo:101: 00010000:00010000:0.0:1789596589.829917:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596589.829929:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ce67d80f/0x8973ae90b38d76e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d76e0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596589.829947:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce67d80f/0x8973ae90b38d76e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d76e0 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596589.829962:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ce67d80f/0x8973ae90b38d76e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d76e0 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596589.829969:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ce67d80f, rc 0) 00000100:00100000:0.0:1789596589.830015:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000034e16b7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:5822:x1876527964751488:12345-0@lo:101: Request processed in 110us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596589.830021:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789596589.830150:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000066a5de73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964751488:0@lo:101: 00010000:00010000:1.0:1789596589.830161:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: 0000000059cbd8c1/0x8973ae90b38d76e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d76e7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596589.830169:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: 0000000059cbd8c1/0x8973ae90b38d76e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d76e7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596589.830227:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008fb556b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964751616:0@lo:501: 00000100:00100000:1.0:1789596589.830254:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596589.830281:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ffc3b22e going to sleep for 11 seconds 00000100:00100000:0.0:1789596589.830325:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964751616 00000100:00100000:0.0:1789596589.830329:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964751616 00000100:00100000:0.0:1789596589.830398:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789596589.830405:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005198224b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:5822:x1876527964751616:12345-0@lo:501: 00000100:00100000:0.0:1789596589.830913:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005198224b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:5822:x1876527964751616:12345-0@lo:501: Request processed in 506us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596589.830920:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789596589.831383:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008fb556b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964751616:0@lo:501: 00000100:00100000:1.0:1789596589.831416:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008fb556b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964751744:0@lo:503: 00000100:00100000:1.0:1789596589.831457:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596589.831488:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ffc3b22e going to sleep for 11 seconds 00000100:00100000:2.0:1789596589.831580:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964751744 00000100:00100000:2.0:1789596589.831585:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964751744 00000100:00100000:2.0:1789596589.831608:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789596589.831614:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bf62a74a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:5822:x1876527964751744:12345-0@lo:503: 00000040:00080000:2.0:1789596589.831648:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789596589.831692:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bf62a74a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:5822:x1876527964751744:12345-0@lo:503: Request processed in 78us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596589.831700:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789596589.831777:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008fb556b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964751744:0@lo:503: 00000040:00080000:2.0:1789596589.833159:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1789596589.833279:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1789596589.833296:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789596589.833318:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: 0000000059cbd8c1/0x8973ae90b38d76e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d76e7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596589.833329:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: 0000000059cbd8c1/0x8973ae90b38d76e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d76e7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596589.833450:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789596589.833453:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ea8e4942800 10000000:01000000:1.0:1789596589.833455:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ea8e4942800 10000000:01000000:1.0:1789596589.833459:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789596589.833463:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ea8e4942800 from 1 10000000:01000000:1.0:1789596589.833466:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789596589.833495:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: 0000000052558bb8/0x8973ae90b38d76ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596589.833502:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: 0000000052558bb8/0x8973ae90b38d76ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596589.833510:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: 0000000052558bb8/0x8973ae90b38d76ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596589.833527:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008fb556b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964751872:0@lo:101: 00000100:00100000:1.0:1789596589.833571:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596589.833602:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b3b9d18 going to sleep for 11 seconds 00000100:00100000:1.0:1789596589.833623:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964751872 00000100:00100000:1.0:1789596589.833628:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964751872 00000100:00100000:1.0:1789596589.833660:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789596589.833665:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b6077d81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:5822:x1876527964751872:12345-0@lo:101: 00010000:00010000:1.0:1789596589.833688:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596589.833698:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bb44b37a/0x8973ae90b38d76f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d76ee expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596589.833716:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bb44b37a/0x8973ae90b38d76f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d76ee expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596589.833727:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bb44b37a/0x8973ae90b38d76f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d76ee expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596589.833735:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bb44b37a, rc 0) 00000100:00100000:1.0:1789596589.833767:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b6077d81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5822:x1876527964751872:12345-0@lo:101: Request processed in 102us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596589.833773:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789596589.833812:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008fb556b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964751872:0@lo:101: 00010000:00010000:1.0:1789596589.833913:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: 0000000052558bb8/0x8973ae90b38d76ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d76f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596589.833922:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: 0000000052558bb8/0x8973ae90b38d76ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d76f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596589.833964:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008fb556b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964752000:0@lo:501: 00000100:00100000:1.0:1789596589.833987:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596589.834001:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b3b9d18 going to sleep for 11 seconds 00000100:00100000:3.0:1789596589.834120:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964752000 00000100:00100000:3.0:1789596589.834125:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964752000 00000100:00100000:3.0:1789596589.834156:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789596589.834162:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fb0d6a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5822:x1876527964752000:12345-0@lo:501: 00000100:00100000:3.0:1789596589.834455:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fb0d6a28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5822:x1876527964752000:12345-0@lo:501: Request processed in 292us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596589.834462:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789596589.834579:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008fb556b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964752000:0@lo:501: 00000100:00100000:2.0:1789596589.834606:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000835e633f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964752128:0@lo:503: 00000100:00100000:2.0:1789596589.834643:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596589.834672:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000199aeebf going to sleep for 11 seconds 00000100:00100000:3.0:1789596589.834712:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964752128 00000100:00100000:3.0:1789596589.834716:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964752128 00000100:00100000:3.0:1789596589.834744:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789596589.834750:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000189aaec7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5822:x1876527964752128:12345-0@lo:503: 00000100:00100000:3.0:1789596589.835178:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000189aaec7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5822:x1876527964752128:12345-0@lo:503: Request processed in 427us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596589.835185:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789596589.835257:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000835e633f pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964752128:0@lo:503: 00000100:00100000:2.0:1789596589.835659:0:5869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000835e633f pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:5869:1876527964752256:0@lo:502: 00000100:00100000:2.0:1789596589.835694:0:5869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596589.835722:0:5869:0:(client.c:2716:ptlrpc_set_wait()) set 000000004eebb6ac going to sleep for 11 seconds 00000100:00100000:3.0:1789596589.835764:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964752256 00000100:00100000:3.0:1789596589.835769:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964752256 00000100:00100000:3.0:1789596589.835798:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789596589.835805:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006a390061 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5869:x1876527964752256:12345-0@lo:502: 00000100:00100000:3.0:1789596589.836152:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006a390061 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5869:x1876527964752256:12345-0@lo:502: Request processed in 348us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596589.836159:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789596589.836225:0:5869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000835e633f pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:5869:1876527964752256:0@lo:502: 00000020:01000004:2.0:1789596589.836276:0:5869:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789596589.836291:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000e4f3ceee) 00000020:00000080:2.0:1789596589.836308:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789596589.836441:0:5869:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ec172519 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789596589.836446:0:5869:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ec172519 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789596589.836449:0:5869:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ec172519 4 00010000:00080000:2.0:1789596589.836474:0:5869:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000820b2775@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.144@tcp at head 00010000:00010000:3.0:1789596589.839189:0:5869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789596589.839467:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789596589.839503:0:5869:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789596589.839516:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8973ae90b38d7703 00000100:00080000:3.0:1789596589.839526:0:5869:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789596589.839536:0:5869:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000820b2775 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:3.0:1789596589.839568:0:5869:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b1b39a12 x1876527964752384/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789596589.839595:0:5869:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789596589.839805:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b1b39a12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876527964752384:0@lo:38: 00000100:00100000:2.0:1789596589.839962:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596589.840071:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964752384 00000100:00100000:1.0:1789596589.840079:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964752384 00000100:00100000:1.0:1789596589.840124:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789596589.840130:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000835e633f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876527964752384:12345-0@lo:38: 00000100:00100000:1.0:1789596589.840190:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000835e633f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876527964752384:12345-0@lo:38: Request processed in 59us (229us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789596589.840198:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789596589.840234:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789596589.840241:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000820b2775 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789596589.840245:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789596589.840248:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b1b39a12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876527964752384:0@lo:38: 00000100:00100000:3.0:1789596589.840549:0:5869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e568a47 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:5869:1876527964752512:0@lo:502: 00000100:00100000:3.0:1789596589.840600:0:5869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596589.840629:0:5869:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fb8ffd3f going to sleep for 11 seconds 00000100:00100000:1.0:1789596589.840670:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964752512 00000100:00100000:1.0:1789596589.840674:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964752512 00000100:00100000:1.0:1789596589.840707:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789596589.840713:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d623d8f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5869:x1876527964752512:12345-0@lo:502: 00000100:00100000:1.0:1789596589.841006:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d623d8f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5869:x1876527964752512:12345-0@lo:502: Request processed in 293us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596589.841014:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789596589.841053:0:5869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e568a47 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:5869:1876527964752512:0@lo:502: 00000040:00080000:1.0:1789596589.841072:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1789596589.841131:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1789596589.841149:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789596589.841162:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: 0000000052558bb8/0x8973ae90b38d76ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d76f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596589.841171:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: 0000000052558bb8/0x8973ae90b38d76ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d76f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789596589.841210:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789596589.841212:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789596589.841214:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789596589.841215:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789596589.841220:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789596589.841221:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789596589.841222:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789596589.841224:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789596589.841225:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789596589.841226:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789596589.841227:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789596589.841228:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789596589.841232:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1789596589.841234:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789596589.841235:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789596589.841236:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789596589.841237:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789596589.841238:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789596589.841239:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789596589.841240:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789596589.841241:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789596589.841242:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789596589.841242:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789596589.841243:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789596589.841244:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789596589.841257:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789596589.841264:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db92b725 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964752640:0@lo:253: 00000100:00100000:1.0:1789596589.841292:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596589.841304:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ffc3b22e going to sleep for 11 seconds 00000100:00100000:3.0:1789596589.841527:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964752640 00000100:00100000:3.0:1789596589.841532:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964752640 00000100:00100000:3.0:1789596589.841556:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789596589.841562:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004d7e7f54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5822:x1876527964752640:12345-0@lo:253: 20000000:01000000:3.0:1789596589.841589:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789596589.841601:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1789596589.851127:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1789596589.903452:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789596589.903474:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789596589.903702:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789596589.903706:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789596589.903724:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d770a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596589.903743:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c1486d5a/0x8973ae90b38d76d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d76d2 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596589.903750:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d770a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596589.903787:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c1486d5a/0x8973ae90b38d76d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d76d2 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596589.904040:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c1486d5a/0x8973ae90b38d76d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d76d2 expref: 12 pid: 5834 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596589.904055:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000012ed3c87 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1876527964752768:0@lo:104: 00000100:00100000:1.0:1789596589.904130:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596589.904187:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d931f90e going to sleep for 11 seconds 00000100:00100000:3.0:1789596589.904268:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964752768 00000100:00100000:3.0:1789596589.904277:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964752768 00000100:00100000:3.0:1789596589.904325:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789596589.904333:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007643fa11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:5857:x1876527964752768:12345-0@lo:104: 00010000:00010000:3.0:1789596589.904475:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: 00000000db106471/0x8973ae90b38d76d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d76d9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596589.904531:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789596589.904536:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007643fa11 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:5857:x1876527964752768:12345-0@lo:104: Request processed in 205us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596589.904543:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789596589.904577:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000012ed3c87 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1876527964752768:0@lo:104: 00010000:00010000:3.0:1789596589.904599:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d770a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.905093:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596589.905099:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: 00000000db106471/0x8973ae90b38d76d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d76d9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.905118:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000db106471 already unused, calling callback (000000006db82b73) 10000000:00010000:2.0:1789596589.905121:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: 00000000db106471/0x8973ae90b38d76d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d76d9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.905129:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: 00000000db106471/0x8973ae90b38d76d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d76d9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596589.905135:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: 00000000db106471/0x8973ae90b38d76d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d76d9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596589.905141:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596589.905168:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: 00000000db106471/0x8973ae90b38d76d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d76d9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.905174:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596589.905189:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: 00000000db106471/0x8973ae90b38d76d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d76d9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.905195:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: 00000000db106471/0x8973ae90b38d76d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d76d9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.905211:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596589.905212:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596589.905214:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596589.905272:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000beba2591 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964752896:0@lo:103: 00000100:00100000:2.0:1789596589.905314:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596589.905544:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964752896 00000100:00100000:2.0:1789596589.905549:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964752896 00010000:00010000:2.0:1789596589.905567:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c1486d5a/0x8973ae90b38d76d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d76d2 expref: 13 pid: 5834 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596589.905595:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789596589.905600:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004040cec2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:3307:x1876527964752896:12345-0@lo:103: 00010000:00010000:2.0:1789596589.905610:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596589.905614:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c1486d5a/0x8973ae90b38d76d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d76d2 expref: 13 pid: 5834 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.905622:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c1486d5a/0x8973ae90b38d76d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d76d2 expref: 13 pid: 5834 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.905634:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c1486d5a/0x8973ae90b38d76d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d76d2 expref: 13 pid: 5834 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.905645:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d770a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.905652:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d770a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789596589.905664:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001958606s 00010000:00010000:2.0:1789596589.905668:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d770a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.905673:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d770a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.905687:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d770a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.905693:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d770a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.905698:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dbd87c69 already unused, calling callback (00000000ed09425e) 00010000:00010000:2.0:1789596589.905700:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d770a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.905707:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d770a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.905720:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d770a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.905730:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596589.905757:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004040cec2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:3307:x1876527964752896:12345-0@lo:103: Request processed in 157us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596589.905763:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789596589.905793:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000beba2591 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964752896:0@lo:103: 00010000:00010000:2.0:1789596589.905808:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d770a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.905837:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d770a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596589.905842:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d770a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596589.922128:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004d7e7f54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:5822:x1876527964752640:12345-0@lo:253: Request processed in 80559us (80828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596589.922144:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789596589.922254:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db92b725 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:5822:1876527964752640:0@lo:253: 10000000:01000000:2.0:1789596589.922272:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789596589.922275:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789596589.922276:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789596589.922277:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596589.922278:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789596589.922280:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596589.922281:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596589.922282:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789596589.922283:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789596589.922284:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789596589.922285:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789596589.922287:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596589.922288:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789596589.922306:0:5822:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789596589.929125:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789596589.931766:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789596589.932310:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789596589.932610:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789596589.932788:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789596589.933577:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789596589.935025:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789596589.935224:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789596589.935552:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789596589.935732:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789596589.936333:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789596589.936598:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1789596589.985206:0:5822:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789596590.050640:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789596590.051496:0:5875:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1789596590.062454:0:5874:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789596590.062464:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789596590.066729:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789596590.066963:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789596590.076608:0:5822:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789596590.076627:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789596590.076949:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789596590.080606:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789596590.085802:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789596590.086740:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789596590.087493:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789596590.087697:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1789596590.095507:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789596590.095676:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789596590.096082:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789596590.096415:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789596590.096544:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789596590.096695:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789596590.096881:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789596590.097022:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789596590.097788:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789596590.098007:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789596590.098150:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789596590.098580:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789596590.098714:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789596590.099007:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789596590.100289:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789596590.100530:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789596590.100797:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789596590.105233:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789596590.105409:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789596590.105557:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789596590.105698:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789596590.105882:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789596590.106043:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789596590.113610:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789596590.113789:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789596590.114025:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789596590.114669:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789596590.114852:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789596590.114999:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789596590.115296:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789596590.115470:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789596590.115616:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789596590.115799:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1789596590.212865:0:5875:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1789596590.308083:0:5822:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789596590.308131:0:5822:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc02841c5f988 00100000:10000000:0.0:1789596590.308140:0:5822:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789596590.313775:0:5822:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789596590.313792:0:5822:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.144@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789596590.313805:0:5822:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789596590.313861:0:5822:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1789596590.356913:0:5875:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789596590.356983:0:5875:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789596590.356988:0:5875:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1789596590.875198:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596591.905544:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596592.934119:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596593.948390:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596594.982909:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789596595.227050:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789596595.227068:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789596595.227071:0:38:0:(import.c:65:import_set_state_nolock()) 00000000820b2775 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789596595.227089:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000820b2775 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:1.0:1789596595.227111:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004c8f8814 x1876527964753152/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789596595.227146:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c8f8814 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876527964753152:0@lo:38: 00000100:00100000:1.0:1789596595.227239:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596595.227318:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964753152 00000100:00100000:1.0:1789596595.227326:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964753152 00000100:00100000:1.0:1789596595.227369:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789596595.227375:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001b8e1dae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876527964753152:12345-0@lo:38: 00010000:00080000:1.0:1789596595.227399:0:5843:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:1.0:1789596595.227434:0:5843:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8973ae90b38d7711 00000004:00100000:1.0:1789596595.227475:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789596595.227588:0:5843:0:(import.c:65:import_set_state_nolock()) 0000000070d2dfee : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789596595.227635:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001b8e1dae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876527964753152:12345-0@lo:38: Request processed in 258us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596595.227651:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789596595.227705:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004c8f8814 x1876527964753152/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789596605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789596595.227719:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789596595.227726:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789596595.227730:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789596595.227732:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000820b2775 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789596595.227737:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c8f8814 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876527964753152:0@lo:38: 00000100:00100000:2.0:1789596595.228146:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008151d693 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964753024:0@lo:400: 00000100:00100000:2.0:1789596595.228186:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596595.228310:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964753024 00000100:00100000:1.0:1789596595.228316:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964753024 00000100:00100000:1.0:1789596595.228353:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789596595.228369:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cd61aa73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:3308:x1876527964753024:12345-0@lo:400: 00000100:00100000:1.0:1789596595.228407:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cd61aa73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:3308:x1876527964753024:12345-0@lo:400: Request processed in 40us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596595.228413:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789596595.228446:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008151d693 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964753024:0@lo:400: 00000001:02000400:3.0:1789596595.677586:0:6117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg244-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789596595.997002:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789596596.762912:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789596596.762919:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ea8e4942800 from 3 10000000:01000000:3.0:1789596596.762923:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789596596.762968:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: 0000000092671b22/0x8973ae90b38d7718 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596596.762981:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: 0000000092671b22/0x8973ae90b38d7718 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596596.762991:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: 0000000092671b22/0x8973ae90b38d7718 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596596.763022:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000001b4b8bf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964753280:0@lo:101: 00000100:00100000:3.0:1789596596.763100:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596596.763184:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000920a1849 going to sleep for 11 seconds 00000100:00100000:0.0:1789596596.765458:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964753280 00000100:00100000:0.0:1789596596.765475:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964753280 00000100:00100000:0.0:1789596596.765549:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789596596.765557:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e9948f7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:5838:x1876527964753280:12345-0@lo:101: 00010000:00010000:0.0:1789596596.765575:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596596.765591:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000004df3077/0x8973ae90b38d771f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d7718 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596596.765616:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000004df3077/0x8973ae90b38d771f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d7718 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596596.765628:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000004df3077/0x8973ae90b38d771f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7718 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596596.765635:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000004df3077, rc 0) 00000100:00100000:0.0:1789596596.765696:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e9948f7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5838:x1876527964753280:12345-0@lo:101: Request processed in 140us (2596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596596.765702:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789596596.766070:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000001b4b8bf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964753280:0@lo:101: 00010000:00010000:2.0:1789596596.766088:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: 0000000092671b22/0x8973ae90b38d7718 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d771f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596596.766096:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: 0000000092671b22/0x8973ae90b38d7718 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d771f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596596.766163:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000beba2591 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964753408:0@lo:256: 00000100:00100000:2.0:1789596596.766219:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596596.766250:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ef8c3777 going to sleep for 11 seconds 00000100:00100000:0.0:1789596596.766464:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964753408 00000100:00100000:0.0:1789596596.766469:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964753408 00000100:00100000:0.0:1789596596.766495:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789596596.766501:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb394a05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5838:x1876527964753408:12345-0@lo:256: 20000000:01000000:0.0:1789596596.766514:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789596596.766532:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789596596.766535:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789596596.766608:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb394a05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5838:x1876527964753408:12345-0@lo:256: Request processed in 107us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596596.766622:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789596596.766653:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000beba2591 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964753408:0@lo:256: 10000000:01000000:0.0:1789596596.766688:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789596596.766695:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: 0000000092671b22/0x8973ae90b38d7718 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d771f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596596.766702:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: 0000000092671b22/0x8973ae90b38d7718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d771f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596597.019099:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596598.042966:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596599.070512:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596600.090961:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596600.349852:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad439166 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964753664:0@lo:400: 00000100:00100000:2.0:1789596600.349925:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596600.350031:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964753664 00000100:00100000:2.0:1789596600.350038:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964753664 00000100:00100000:2.0:1789596600.350089:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789596600.350095:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fd1c7a1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964753664:12345-0@lo:400: 00000100:00100000:2.0:1789596600.350141:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fd1c7a1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964753664:12345-0@lo:400: Request processed in 47us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596600.350148:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789596600.350180:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ad439166 x1876527964753664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596600.350193:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad439166 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964753664:0@lo:400: 00000100:00100000:0.0:1789596600.350334:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596600.350344:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bedcca7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964753536:0@lo:400: 00000100:00100000:0.0:1789596600.350379:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596600.350762:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964753536 00000100:00100000:2.0:1789596600.350767:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964753536 00000100:00100000:2.0:1789596600.350871:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789596600.350878:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000093fd6a49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:3308:x1876527964753536:12345-0@lo:400: 00000100:00100000:2.0:1789596600.350919:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000093fd6a49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:3308:x1876527964753536:12345-0@lo:400: Request processed in 43us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596600.350925:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789596600.350995:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bedcca7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964753536:0@lo:400: 00000020:00000080:1.0:1789596600.577221:0:6320:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa26c9c10 20000000:00000080:1.0:1789596600.577240:0:6320:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ea8e4848000 uarg=0000000000000000 20000000:01000000:1.0:1789596600.577275:0:6320:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789596600.577282:0:6320:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789596600.577286:0:6320:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789596600.577630:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789596600.577642:0:6320:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1789596600.582091:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789596600.582351:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789596600.582411:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1789596600.582475:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1789596600.582771:0:6320:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789596600.582790:0:6320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d7726 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596600.582808:0:6320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ce67d80f/0x8973ae90b38d76e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d76e0 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596600.582947:0:6320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d7726 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596600.582987:0:6320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ce67d80f/0x8973ae90b38d76e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d76e0 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596600.583000:0:6320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ce67d80f/0x8973ae90b38d76e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d76e0 expref: 11 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596600.583050:0:6320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008151d693 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1876527964753792:0@lo:104: 00000100:00100000:1.0:1789596600.583109:0:6320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596600.583164:0:6320:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c7f0943e going to sleep for 11 seconds 00000100:00100000:2.0:1789596600.583230:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964753792 00000100:00100000:2.0:1789596600.583239:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964753792 00000100:00100000:2.0:1789596600.583288:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789596600.583296:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004c8f8814 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:6320:x1876527964753792:12345-0@lo:104: 00010000:00010000:2.0:1789596600.583315:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: 0000000059cbd8c1/0x8973ae90b38d76e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d76e7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596600.583374:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789596600.583379:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004c8f8814 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:6320:x1876527964753792:12345-0@lo:104: Request processed in 85us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596600.583387:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789596600.583463:0:6320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008151d693 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1876527964753792:0@lo:104: 00010000:00010000:1.0:1789596600.583491:0:6320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d7726 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596600.583599:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596600.583605:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: 0000000059cbd8c1/0x8973ae90b38d76e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d76e7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596600.583612:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000059cbd8c1 already unused, calling callback (000000006db82b73) 10000000:00010000:0.0:1789596600.583615:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: 0000000059cbd8c1/0x8973ae90b38d76e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d76e7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596600.583622:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: 0000000059cbd8c1/0x8973ae90b38d76e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d76e7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596600.583628:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: 0000000059cbd8c1/0x8973ae90b38d76e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d76e7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596600.583642:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789596600.583702:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: 0000000059cbd8c1/0x8973ae90b38d76e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d76e7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596600.583709:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789596600.583751:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba4a7063 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964753920:0@lo:103: 00000100:00100000:1.0:1789596600.583780:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596600.583844:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964753920 00000100:00100000:2.0:1789596600.583848:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964753920 00010000:00010000:2.0:1789596600.583865:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ce67d80f/0x8973ae90b38d76e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d76e0 expref: 12 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596600.583887:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789596600.583893:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008151d693 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:3307:x1876527964753920:12345-0@lo:103: 00010000:00010000:2.0:1789596600.583902:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596600.583906:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ce67d80f/0x8973ae90b38d76e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d76e0 expref: 12 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596600.583915:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ce67d80f/0x8973ae90b38d76e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d76e0 expref: 12 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596600.583927:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ce67d80f/0x8973ae90b38d76e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d76e0 expref: 12 pid: 5836 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596600.583940:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d7726 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596600.583947:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d7726 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596600.583968:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d7726 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596600.583974:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d7726 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596600.583980:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d7726 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596600.583985:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d7726 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596600.583990:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dbd87c69 already unused, calling callback (00000000ed09425e) 00010000:00010000:2.0:1789596600.583994:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d7726 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596600.584000:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d7726 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596600.584022:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d7726 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596600.584031:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596600.584089:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: 0000000059cbd8c1/0x8973ae90b38d76e0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d76e7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596600.584096:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: 0000000059cbd8c1/0x8973ae90b38d76e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d76e7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596600.584114:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596600.584116:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596600.584117:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596600.584525:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008151d693 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:3307:x1876527964753920:12345-0@lo:103: Request processed in 631us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596600.584533:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789596600.584669:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba4a7063 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964753920:0@lo:103: 00010000:00010000:1.0:1789596600.584749:0:6320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d7726 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596600.584769:0:6320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d7726 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596600.584774:0:6320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dbd87c69/0x8973ae90b38d7726 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596601.122834:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596602.140374:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596603.163203:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596604.194247:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789596604.957154:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789596604.957162:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea8e4942800 from 1 10000000:01000000:0.0:1789596604.957167:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789596604.957209:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: 00000000a03b20a2/0x8973ae90b38d772d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596604.957222:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: 00000000a03b20a2/0x8973ae90b38d772d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596604.957233:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: 00000000a03b20a2/0x8973ae90b38d772d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596604.957260:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cce3a21 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964754048:0@lo:101: 00000100:00100000:0.0:1789596604.957324:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596604.957407:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b28d8462 going to sleep for 11 seconds 00000100:00100000:1.0:1789596604.961634:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964754048 00000100:00100000:1.0:1789596604.961649:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964754048 00000100:00100000:1.0:1789596604.962034:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789596604.962044:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003ee21910 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:5838:x1876527964754048:12345-0@lo:101: 00010000:00010000:1.0:1789596604.962062:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596604.962080:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009cccb0c2/0x8973ae90b38d7734 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d772d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596604.962105:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009cccb0c2/0x8973ae90b38d7734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d772d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596604.962117:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009cccb0c2/0x8973ae90b38d7734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d772d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596604.962126:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009cccb0c2, rc 0) 00000100:00100000:1.0:1789596604.962207:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003ee21910 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5838:x1876527964754048:12345-0@lo:101: Request processed in 165us (4883us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596604.962214:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789596604.962306:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cce3a21 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964754048:0@lo:101: 00010000:00010000:0.0:1789596604.962332:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: 00000000a03b20a2/0x8973ae90b38d772d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7734 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596604.962341:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: 00000000a03b20a2/0x8973ae90b38d772d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7734 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596604.962402:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005cce3a21 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964754176:0@lo:501: 00000100:00100000:0.0:1789596604.962433:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596604.962471:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b28d8462 going to sleep for 11 seconds 00000100:00100000:1.0:1789596604.962512:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964754176 00000100:00100000:1.0:1789596604.962517:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964754176 00000100:00100000:1.0:1789596604.962586:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789596604.962592:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000069e1795a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5838:x1876527964754176:12345-0@lo:501: 00000100:00100000:1.0:1789596604.962899:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000069e1795a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5838:x1876527964754176:12345-0@lo:501: Request processed in 307us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596604.962906:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789596604.964552:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005cce3a21 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964754176:0@lo:501: 00000100:00100000:1.0:1789596604.964601:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f7efd1f1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964754304:0@lo:503: 00000100:00100000:1.0:1789596604.964658:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596604.964938:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 000000009a221e52 going to sleep for 11 seconds 00000100:00100000:2.0:1789596604.965105:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964754304 00000100:00100000:2.0:1789596604.965113:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964754304 00000100:00100000:2.0:1789596604.965159:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789596604.965167:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a41986d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5838:x1876527964754304:12345-0@lo:503: 00000100:00100000:2.0:1789596604.965510:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a41986d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5838:x1876527964754304:12345-0@lo:503: Request processed in 345us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596604.965518:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789596604.968568:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f7efd1f1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964754304:0@lo:503: 00000100:00100000:1.0:1789596604.969123:0:6600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000056862d9c pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:6600:1876527964754432:0@lo:502: 00000100:00100000:1.0:1789596604.969185:0:6600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596604.969224:0:6600:0:(client.c:2716:ptlrpc_set_wait()) set 00000000041e1d17 going to sleep for 11 seconds 00000100:00100000:0.0:1789596604.969342:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964754432 00000100:00100000:0.0:1789596604.969349:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964754432 00000100:00100000:0.0:1789596604.969390:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789596604.969397:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f2c0be43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:6600:x1876527964754432:12345-0@lo:502: 00000100:00100000:0.0:1789596604.969611:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f2c0be43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:6600:x1876527964754432:12345-0@lo:502: Request processed in 214us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596604.969618:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789596604.969804:0:6600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000056862d9c pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:6600:1876527964754432:0@lo:502: 00000020:01000000:1.0:1789596604.969854:0:6600:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596604.969864:0:6600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596604.969866:0:6600:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789596604.969873:0:6600:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ea8e4942800 00000020:00000080:1.0:1789596604.969876:0:6600:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789596604.969910:0:6600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5781180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:6600:1876527964754560:0@lo:502: 00000100:00100000:1.0:1789596604.969939:0:6600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596604.969954:0:6600:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c3082c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789596604.970023:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964754560 00000100:00100000:0.0:1789596604.970027:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964754560 00000100:00100000:0.0:1789596604.970044:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789596604.970049:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:6600:x1876527964754560:12345-0@lo:502: 00000100:00100000:0.0:1789596604.970142:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:6600:x1876527964754560:12345-0@lo:502: Request processed in 92us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596604.970149:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789596604.970215:0:6600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5781180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:6600:1876527964754560:0@lo:502: 00000020:01000000:1.0:1789596604.970232:0:6600:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596604.970235:0:6600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596604.970237:0:6600:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789596604.970240:0:6600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789596604.970358:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789596604.970376:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789596604.970384:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d772d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7734 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596604.970400:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d772d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7734 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596605.211011:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596605.467657:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596605.471596:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876527964754816:0@lo:400: 00000100:00100000:0.0:1789596605.471677:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596605.471790:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964754688:0@lo:400: 00000100:00100000:0.0:1789596605.471836:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596605.472483:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964754688 00000100:00100000:3.0:1789596605.472494:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964754688 00000100:00100000:3.0:1789596605.472543:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789596605.472553:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:3309:x1876527964754688:12345-0@lo:400: 00000100:00100000:3.0:1789596605.472606:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:3309:x1876527964754688:12345-0@lo:400: Request processed in 54us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596605.472613:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789596605.474053:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964754688:0@lo:400: 00000100:00100000:1.0:1789596605.476275:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964754816 00000100:00100000:1.0:1789596605.476304:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964754816 00000100:00100000:1.0:1789596605.476365:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789596605.476376:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876527964754816:12345-0@lo:400: 00000100:00100000:1.0:1789596605.476479:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876527964754816:12345-0@lo:400: Request processed in 106us (4801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596605.476486:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789596605.476877:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ea900008e00 x1876527964754816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596605.476904:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876527964754816:0@lo:400: 00010000:00010000:2.0:1789596606.235506:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789596606.870056:0:6690:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789596606.870060:0:6690:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789596606.870177:0:6690:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ea8f9e94000 00000020:01000004:3.0:1789596606.870191:0:6690:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789596606.870202:0:6690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789596606.870216:0:6690:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ea8f745b380) 00000020:00000080:3.0:1789596606.870230:0:6690:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789596606.891643:0:6690:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789596606.892276:0:6690:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789596606.918988:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789596606.925242:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789596606.925279:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789596606.925335:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789596606.925438:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789596606.926154:0:6690:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789596606.926176:0:6690:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789596606.926187:0:6690:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8973ae90b38d7742 00000020:01000004:3.0:1789596606.926196:0:6690:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789596606.926221:0:6690:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.144@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789596606.926224:0:6690:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789596606.926231:0:6690:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789596606.926235:0:6690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789596606.926247:0:6690:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ea8f74599c0) 00000020:00000080:3.0:1789596606.926256:0:6690:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1789596606.929192:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789596606.929384:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789596606.929390:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789596606.930288:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789596606.930296:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789596606.932256:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789596606.932272:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789596606.937753:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789596606.938095:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789596606.938102:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789596606.939560:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789596606.939570:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789596606.961715:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789596606.962110:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789596606.962117:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789596606.963868:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789596606.963881:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789596606.964602:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789596606.964610:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789596606.967546:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789596606.968528:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789596606.968668:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789596606.969404:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789596606.969411:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789596607.014152:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789596607.014629:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789596607.014637:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789596607.015991:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789596607.016003:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789596607.016548:0:6690:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789596607.016571:0:6690:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789596607.016578:0:6690:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.144@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789596607.043300:0:6690:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.144@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789596607.043341:0:6690:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.144@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789596607.043346:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789596607.043348:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789596607.043349:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596607.043350:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789596607.043351:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596607.043353:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596607.043354:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789596607.043355:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789596607.043357:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789596607.043358:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596607.043359:0:6690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789596607.043362:0:6690:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789596607.043364:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789596607.043365:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789596607.043366:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596607.043367:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789596607.043368:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596607.043369:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596607.043370:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789596607.043371:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789596607.043373:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789596607.043374:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596607.043374:0:6690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789596607.043400:0:6690:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789596607.043418:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964754944:0@lo:253: 00000100:00100000:2.0:1789596607.043569:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596607.043699:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8e484c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789596607.043977:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964754944 00000100:00100000:3.0:1789596607.043986:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964754944 00000100:00100000:3.0:1789596607.044078:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789596607.044087:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:6690:x1876527964754944:12345-0@lo:253: 20000000:01000000:3.0:1789596607.044127:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789596607.044131:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789596607.044136:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789596607.044139:0:5836:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789596607.045381:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789596607.045625:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789596607.045639:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789596607.046577:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1789596607.046592:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789596607.046638:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1789596607.046775:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1789596607.047665:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789596607.049171:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.144@tcp 20000000:01000000:3.0:1789596607.049176:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.144@tcp (null) (null) (null) 00000040:00080000:3.0:1789596607.049254:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789596607.049276:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789596607.049346:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789596607.049353:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.144@tcp (null) (null) 00000040:00080000:3.0:1789596607.049385:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789596607.049394:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789596607.049427:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789596607.049557:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1789596607.050921:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789596607.050944:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.144@tcp 20000000:01000000:3.0:1789596607.050958:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.144@tcp (null) (null) (null) 00000040:00080000:3.0:1789596607.050995:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789596607.051003:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789596607.051033:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789596607.051040:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.144@tcp (null) (null) 00000040:00080000:3.0:1789596607.051228:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789596607.051238:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789596607.051273:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1789596607.051309:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1789596607.051325:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1789596607.051328:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1789596607.051335:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789596607.051337:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789596607.051339:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789596607.051352:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789596607.051354:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789596607.051385:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789596607.051388:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789596607.052383:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789596607.052443:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789596607.052573:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789596607.053239:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1789596607.053284:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1789596607.053316:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1789596607.053330:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789596607.053332:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789596607.053805:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789596607.054262:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1789596607.054299:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1789596607.054356:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1789596607.054369:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789596607.054371:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789596607.055010:0:6707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1789596607.055068:0:6707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1789596607.055117:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1789596607.055379:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1789596607.055419:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1789596607.055477:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:1.0:1789596607.055498:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789596607.055517:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ea9021f9800/0x8973ae90b38d7750 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.055536:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea902045a00/0x8973ae90b38d7669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7662 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.055544:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea9021f8c00/0x8973ae90b38d7685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d767e expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.055550:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d76f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d76ee expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.055559:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ea9021f9800/0x8973ae90b38d7750 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.055600:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d76f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d76ee expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.055614:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d76f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d76ee expref: 12 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596607.055641:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5781180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876527964755072:0@lo:104: 00000100:00100000:1.0:1789596607.055724:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789596607.055797:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea9021f8c00/0x8973ae90b38d7685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d767e expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.055806:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea9021f8c00/0x8973ae90b38d7685 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d767e expref: 12 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596607.055930:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5781880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876527964755200:0@lo:104: 00000100:00100000:1.0:1789596607.055966:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789596607.055995:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea902045a00/0x8973ae90b38d7669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d7662 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.056004:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea902045a00/0x8973ae90b38d7669 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d7662 expref: 12 pid: 5835 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596607.056012:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5780e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876527964755328:0@lo:104: 00000100:00100000:1.0:1789596607.056033:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596607.056044:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6e5ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596607.056122:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964755072 00000100:00100000:2.0:1789596607.056130:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964755072 00000100:00100000:2.0:1789596607.056161:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964755200 00000100:00100000:2.0:1789596607.056164:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964755200 00000100:00100000:2.0:1789596607.056174:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964755328 00000100:00100000:2.0:1789596607.056176:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964755328 00000100:00100000:2.0:1789596607.056188:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789596607.056197:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+5:5836:x1876527964755072:12345-0@lo:104: 00010000:00010000:2.0:1789596607.056217:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d76ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d76f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.056279:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789596607.056285:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+5:5836:x1876527964755072:12345-0@lo:104: Request processed in 90us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596607.056293:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789596607.056314:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789596607.056319:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5780700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+4:5836:x1876527964755200:12345-0@lo:104: 00010000:00010000:2.0:1789596607.056327:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d767e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7685 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.056356:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789596607.056361:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5780700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+4:5836:x1876527964755200:12345-0@lo:104: Request processed in 43us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596607.056367:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789596607.056377:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789596607.056383:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:5836:x1876527964755328:12345-0@lo:104: 00010000:00010000:2.0:1789596607.056390:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d7662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7669 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.056414:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789596607.056419:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:5836:x1876527964755328:12345-0@lo:104: Request processed in 37us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596607.056424:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789596607.056441:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789596607.056446:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d76ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d76f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.056459:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f9600 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596607.056463:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d76ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d76f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.056470:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d76ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d76f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596607.056476:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d76ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d76f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596607.056481:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596607.056509:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d76ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d76f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.056515:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596607.056535:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d76ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d76f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.056542:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d76ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d76f5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.056555:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789596607.056558:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d767e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7685 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.056563:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483200 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596607.056566:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d767e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d7685 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.056583:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d767e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d7685 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596607.056588:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d767e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d7685 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596607.056593:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596607.056606:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d767e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7685 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.056612:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596607.056618:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d767e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7685 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.056624:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d767e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7685 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.056634:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596607.056637:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d7662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7669 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.056642:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483600 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596607.056645:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d7662 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d7669 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.056651:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d7662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d7669 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596607.056658:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d7662 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d7669 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596607.056671:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596607.056684:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d7662 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7669 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.056689:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596607.056705:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d7662 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7669 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.056712:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d7662 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7669 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.056725:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596607.056727:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596607.056729:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596607.056735:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596607.056746:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964755456:0@lo:103: 00000100:00100000:2.0:1789596607.056775:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596607.056796:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596607.056802:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964755584:0@lo:103: 00000100:00100000:1.0:1789596607.057029:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5781180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876527964755072:0@lo:104: 00000100:00100000:1.0:1789596607.057038:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5781880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876527964755200:0@lo:104: 00000100:00100000:1.0:1789596607.057045:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5780e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876527964755328:0@lo:104: 00010000:00010000:1.0:1789596607.057077:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ea9021f9800/0x8973ae90b38d7750 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596607.057159:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596607.057191:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964755712:0@lo:103: 00000100:00100000:2.0:1789596607.057212:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596607.057245:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964755456 00000100:00100000:2.0:1789596607.057249:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964755456 00010000:00010000:2.0:1789596607.057268:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d76f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d76ee expref: 13 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596607.057281:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964755584 00000100:00100000:2.0:1789596607.057290:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964755584 00010000:00010000:2.0:1789596607.057299:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea9021f8c00/0x8973ae90b38d7685 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d767e expref: 14 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596607.057306:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964755712 00000100:00100000:2.0:1789596607.057307:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964755712 00010000:00010000:2.0:1789596607.057312:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea902045a00/0x8973ae90b38d7669 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d7662 expref: 15 pid: 5835 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596607.057319:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789596607.057322:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:3306:x1876527964755456:12345-0@lo:103: 00010000:00010000:2.0:1789596607.057330:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596607.057333:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d76f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d76ee expref: 15 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057340:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d76f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d76ee expref: 15 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057349:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d76f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d76ee expref: 15 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057358:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596607.057385:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:3306:x1876527964755456:12345-0@lo:103: Request processed in 62us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596607.057391:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789596607.057405:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789596607.057411:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:3306:x1876527964755584:12345-0@lo:103: 00010000:00010000:2.0:1789596607.057418:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596607.057422:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea9021f8c00/0x8973ae90b38d7685 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d767e expref: 13 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057437:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea9021f8c00/0x8973ae90b38d7685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d767e expref: 13 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057445:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea9021f8c00/0x8973ae90b38d7685 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d767e expref: 13 pid: 5836 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057454:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596607.057476:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:3306:x1876527964755584:12345-0@lo:103: Request processed in 66us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596607.057482:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789596607.057495:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789596607.057501:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:3308:x1876527964755712:12345-0@lo:103: 00010000:00010000:2.0:1789596607.057508:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596607.057512:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea902045a00/0x8973ae90b38d7669 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d7662 expref: 11 pid: 5835 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057518:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea902045a00/0x8973ae90b38d7669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d7662 expref: 11 pid: 5835 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057525:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea902045a00/0x8973ae90b38d7669 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d7662 expref: 11 pid: 5835 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057534:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ea9021f9800/0x8973ae90b38d7750 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057539:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea9021f9800/0x8973ae90b38d7750 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057548:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea9021f9800/0x8973ae90b38d7750 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057556:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea9021f9800/0x8973ae90b38d7750 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057561:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ea9021f9800/0x8973ae90b38d7750 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057565:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ea9021f9800/0x8973ae90b38d7750 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057568:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f9800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596607.057571:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ea9021f9800/0x8973ae90b38d7750 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057576:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ea9021f9800/0x8973ae90b38d7750 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057585:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ea9021f9800/0x8973ae90b38d7750 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057591:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596607.057609:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+10:3308:x1876527964755712:12345-0@lo:103: Request processed in 110us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596607.057613:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789596607.057632:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964755712:0@lo:103: 00000100:00100000:2.0:1789596607.057644:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964755584:0@lo:103: 00000100:00100000:2.0:1789596607.057648:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964755456:0@lo:103: 00010000:00010000:2.0:1789596607.057657:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ea9021f9800/0x8973ae90b38d7750 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057669:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ea9021f9800/0x8973ae90b38d7750 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.057673:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea9021f9800/0x8973ae90b38d7750 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789596607.057695:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789596607.123357:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+9:6690:x1876527964754944:12345-0@lo:253: Request processed in 79262us (79778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596607.123374:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789596607.123465:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964754944:0@lo:253: 10000000:01000000:1.0:1789596607.123498:0:6690:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789596607.123502:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789596607.123504:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789596607.123505:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789596607.123507:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1789596607.123509:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789596607.123510:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789596607.123512:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789596607.123514:0:6690:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789596607.123515:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789596607.123517:0:6690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789596607.123536:0:6690:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ea8f9e94000 from lustre-OST0000 10000000:01000000:1.0:1789596607.123561:0:6690:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789596607.123564:0:6690:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789596607.123570:0:6690:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ea8c2ca3380 local copy 10000000:01000000:1.0:1789596607.123574:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789596607.123612:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7757 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.123623:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7757 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.123632:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7757 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596607.123650:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964755840:0@lo:101: 00000100:00100000:1.0:1789596607.123761:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596607.123939:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6e5e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789596607.124035:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964755840 00000100:00100000:3.0:1789596607.124048:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964755840 00000100:00100000:3.0:1789596607.124082:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789596607.124090:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+9:6690:x1876527964755840:12345-0@lo:101: 00010000:00010000:3.0:1789596607.124102:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596607.124114:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea902044200/0x8973ae90b38d775e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d7757 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596607.124137:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea902044200/0x8973ae90b38d775e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d7757 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596607.124147:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea902044200/0x8973ae90b38d775e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7757 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596607.124156:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea902044200, rc 0) 00000100:00100000:3.0:1789596607.124196:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+10:6690:x1876527964755840:12345-0@lo:101: Request processed in 108us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596607.124202:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789596607.124288:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964755840:0@lo:101: 00010000:00010000:1.0:1789596607.124300:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7757 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8973ae90b38d775e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.124322:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7757 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8973ae90b38d775e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596607.124426:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964755968:0@lo:501: 00000100:00100000:1.0:1789596607.124453:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596607.124511:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964755968 00000100:00100000:2.0:1789596607.124515:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964755968 00000100:00100000:2.0:1789596607.124546:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789596607.124552:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+10:6690:x1876527964755968:12345-0@lo:501: 00000100:00100000:2.0:1789596607.124757:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+10:6690:x1876527964755968:12345-0@lo:501: Request processed in 204us (302us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789596607.124763:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789596607.131970:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6e5e180 going to sleep for 11 seconds 00000100:00100000:1.0:1789596607.132020:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964755968:0@lo:501: 10000000:01000000:1.0:1789596607.132057:0:6690:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789596607.132118:0:6690:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789596607.132128:0:6690:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7757 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8973ae90b38d775e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.132140:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7757 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8973ae90b38d775e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.132147:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7757 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8973ae90b38d775e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.132168:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789596607.132190:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ea8f9e94000 10000000:01000000:1.0:1789596607.132196:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789596607.132201:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ea8c2ca3380 10000000:01000000:1.0:1789596607.132204:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789596607.132207:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ea8c2ca3380 from 1 10000000:01000000:1.0:1789596607.132210:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789596607.132243:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8c00/0x8973ae90b38d7765 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.132271:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8c00/0x8973ae90b38d7765 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.132283:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8c00/0x8973ae90b38d7765 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596607.132303:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964756096:0@lo:101: 00000100:00100000:1.0:1789596607.132362:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596607.132396:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6e5eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596607.132498:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964756096 00000100:00100000:3.0:1789596607.132506:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964756096 00000100:00100000:3.0:1789596607.132554:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789596607.132562:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+10:6690:x1876527964756096:12345-0@lo:101: 00010000:00010000:3.0:1789596607.132574:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596607.132588:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea902044000/0x8973ae90b38d776c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d7765 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596607.132613:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea902044000/0x8973ae90b38d776c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d7765 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596607.132623:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea902044000/0x8973ae90b38d776c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7765 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596607.132643:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea902044000, rc 0) 00000100:00100000:3.0:1789596607.132698:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:6690:x1876527964756096:12345-0@lo:101: Request processed in 136us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596607.132704:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789596607.132748:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5780e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964756096:0@lo:101: 00010000:00010000:3.0:1789596607.132761:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8c00/0x8973ae90b38d7765 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d776c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596607.132770:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8c00/0x8973ae90b38d7765 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d776c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596607.132790:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789596607.132803:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8c00/0x8973ae90b38d7765 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d776c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596607.132844:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8c00/0x8973ae90b38d7765 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d776c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596607.132851:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789596607.132855:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789596607.132859:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789596607.132862:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789596607.132878:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea902045000/0x8973ae90b38d7773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596607.132885:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea902045000/0x8973ae90b38d7773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596607.132905:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea902045000/0x8973ae90b38d7773 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596607.132919:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964756224:0@lo:101: 00000100:00100000:3.0:1789596607.132957:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596607.132982:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea900034f00 going to sleep for 11 seconds 00010000:00010000:2.0:1789596607.133170:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596607.133177:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7757 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8973ae90b38d775e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.133184:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f9800 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596607.133187:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7757 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8973ae90b38d775e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.133195:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x8973ae90b38d775e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596607.133215:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x8973ae90b38d775e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596607.133220:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596607.133239:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7757 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8973ae90b38d775e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.133245:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596607.133271:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7757 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8973ae90b38d775e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.133280:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7757 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8973ae90b38d775e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.133293:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596607.133295:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596607.133296:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596607.133305:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596607.133315:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964756352:0@lo:103: 00000100:00100000:2.0:1789596607.133346:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596607.133379:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964756352 00000100:00100000:2.0:1789596607.133383:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964756352 00000100:00100000:2.0:1789596607.133414:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789596607.133421:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:3308:x1876527964756352:12345-0@lo:103: 00010000:00010000:2.0:1789596607.133431:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596607.133443:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea902044200/0x8973ae90b38d775e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8973ae90b38d7757 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.133460:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596607.133496:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+10:3308:x1876527964756352:12345-0@lo:103: Request processed in 75us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596607.133503:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789596607.133532:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964756352:0@lo:103: 00000100:00100000:1.0:1789596607.133595:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964756224 00000100:00100000:1.0:1789596607.133599:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964756224 00000100:00100000:1.0:1789596607.134850:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789596607.134868:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+10:6690:x1876527964756224:12345-0@lo:101: 00010000:00010000:1.0:1789596607.134883:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596607.134900:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d777a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d7773 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.134922:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d777a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d7773 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.134933:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d777a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7773 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.134941:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea9021f9e00, rc 0) 00000100:00100000:1.0:1789596607.135008:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:6690:x1876527964756224:12345-0@lo:101: Request processed in 149us (2063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596607.135016:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789596607.135126:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964756224:0@lo:101: 00010000:00010000:3.0:1789596607.135143:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea902045000/0x8973ae90b38d7773 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d777a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596607.135152:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea902045000/0x8973ae90b38d7773 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d777a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596607.135264:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964756480:0@lo:501: 00000100:00100000:3.0:1789596607.135297:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596607.138118:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea900034f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789596607.138318:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964756480 00000100:00100000:2.0:1789596607.138329:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964756480 00000100:00100000:2.0:1789596607.138383:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789596607.138393:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:6690:x1876527964756480:12345-0@lo:501: 00000100:00100000:2.0:1789596607.138798:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:6690:x1876527964756480:12345-0@lo:501: Request processed in 405us (3499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596607.138806:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789596607.139358:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964756480:0@lo:501: 00000100:00100000:3.0:1789596607.139409:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964756608:0@lo:503: 00000100:00100000:3.0:1789596607.139461:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596607.139532:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea900034f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789596607.139591:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964756608 00000100:00100000:0.0:1789596607.139597:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964756608 00000100:00100000:2.0:1789596607.139649:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789596607.139658:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:6690:x1876527964756608:12345-0@lo:503: 00000100:00100000:2.0:1789596607.140260:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:6690:x1876527964756608:12345-0@lo:503: Request processed in 601us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596607.140268:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789596607.140418:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964756608:0@lo:503: 00000040:00080000:3.0:1789596607.140717:0:6690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789596607.140794:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964756736:0@lo:502: 00000100:00100000:3.0:1789596607.141060:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596607.141299:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea900034f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596607.141382:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964756736 00000100:00100000:1.0:1789596607.141394:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964756736 00000100:00100000:1.0:1789596607.141424:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789596607.141431:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:6690:x1876527964756736:12345-0@lo:502: 00000100:00100000:1.0:1789596607.141603:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:6690:x1876527964756736:12345-0@lo:502: Request processed in 171us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596607.141611:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789596607.141716:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964756736:0@lo:502: 00000040:00080000:3.0:1789596607.149239:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789596607.149330:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789596607.149361:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789596607.149410:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789596607.149448:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789596607.149481:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789596607.149536:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964756864:0@lo:502: 00000100:00100000:3.0:1789596607.149615:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596607.149673:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea900034f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789596607.149870:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964756864 00000100:00100000:0.0:1789596607.149879:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964756864 00000100:00100000:0.0:1789596607.149932:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789596607.149941:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:6690:x1876527964756864:12345-0@lo:502: 00000100:00100000:0.0:1789596607.150147:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:6690:x1876527964756864:12345-0@lo:502: Request processed in 205us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596607.150155:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789596607.152643:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964756864:0@lo:502: 00000040:00080000:2.0:1789596607.153262:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789596607.153278:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1789596607.154010:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789596607.154018:0:6710:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789596607.154025:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596607.154027:0:6710:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789596607.154033:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789596607.154114:0:6710:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ea9007b0000) 00000020:00000080:2.0:1789596607.154137:0:6710:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789596607.154144:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789596607.154205:0:6710:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ea8f9e94000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789596607.154229:0:6710:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789596607.154236:0:6710:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8973ae90b38d7788 00010000:00010000:2.0:1789596607.160277:0:6710:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1789596607.160596:0:6710:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789596607.176893:0:6710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789596607.177228:0:6710:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789596607.186461:0:6710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789596607.187448:0:6710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789596607.189328:0:6710:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789596607.189342:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596607.189350:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596607.189352:0:6710:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789596607.189355:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596607.189359:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596607.189360:0:6710:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789596607.189363:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789596607.189365:0:6710:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789596607.189415:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596607.189418:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596607.189419:0:6710:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789596607.189423:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789596607.195156:0:6690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789596607.195203:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789596607.195273:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea902045000/0x8973ae90b38d7773 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d777a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596607.195288:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea902045000/0x8973ae90b38d7773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d777a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596607.197652:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea8f9e94000 from 1 10000000:01000000:2.0:1789596607.197661:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789596607.197723:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d778f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.197736:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d778f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.197746:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d778f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596607.197772:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964756992:0@lo:101: 00000100:00100000:2.0:1789596607.198016:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596607.198065:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c56d3480 going to sleep for 11 seconds 00000100:00100000:3.0:1789596607.198304:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964756992 00000100:00100000:3.0:1789596607.198314:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964756992 00000100:00100000:3.0:1789596607.198361:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789596607.198370:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:6690:x1876527964756992:12345-0@lo:101: 00010000:00010000:3.0:1789596607.198383:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596607.198396:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea902044200/0x8973ae90b38d7796 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d778f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596607.198432:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea902044200/0x8973ae90b38d7796 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d778f expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596607.198444:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea902044200/0x8973ae90b38d7796 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d778f expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596607.198453:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea902044200, rc 0) 00000100:00100000:3.0:1789596607.198502:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:6690:x1876527964756992:12345-0@lo:101: Request processed in 133us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596607.198508:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789596607.198606:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964756992:0@lo:101: 00010000:00010000:2.0:1789596607.198621:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d778f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7796 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596607.198629:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d778f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7796 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596607.199036:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964757120:0@lo:501: 00000100:00100000:2.0:1789596607.199068:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596607.199101:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c56d3480 going to sleep for 11 seconds 00000100:00100000:3.0:1789596607.199748:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964757120 00000100:00100000:3.0:1789596607.199755:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964757120 00000100:00100000:3.0:1789596607.199800:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789596607.199971:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:6690:x1876527964757120:12345-0@lo:501: 00000100:00100000:3.0:1789596607.200209:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:6690:x1876527964757120:12345-0@lo:501: Request processed in 401us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596607.200216:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789596607.200316:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964757120:0@lo:501: 00000100:00100000:2.0:1789596607.200363:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964757248:0@lo:503: 00000100:00100000:2.0:1789596607.200404:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596607.200433:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c56d3480 going to sleep for 11 seconds 00000100:00100000:3.0:1789596607.200688:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964757248 00000100:00100000:3.0:1789596607.200693:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964757248 00000100:00100000:3.0:1789596607.200720:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789596607.200727:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:6690:x1876527964757248:12345-0@lo:503: 00000100:00100000:3.0:1789596607.201062:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:6690:x1876527964757248:12345-0@lo:503: Request processed in 335us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596607.201070:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789596607.201445:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964757248:0@lo:503: 00000040:00080000:0.0:1789596607.201763:0:6690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789596607.202207:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964757376:0@lo:502: 00000100:00100000:1.0:1789596607.202261:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596607.202299:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6e5ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596607.202346:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964757376 00000100:00100000:3.0:1789596607.202352:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964757376 00000100:00100000:3.0:1789596607.202391:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789596607.202406:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:6690:x1876527964757376:12345-0@lo:502: 00000100:00100000:3.0:1789596607.202566:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:6690:x1876527964757376:12345-0@lo:502: Request processed in 161us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596607.202574:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789596607.202649:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964757376:0@lo:502: 00000040:00080000:1.0:1789596607.203158:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789596607.203215:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789596607.203242:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964757504:0@lo:502: 00000100:00100000:1.0:1789596607.203282:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596607.203307:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c905ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596607.203357:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964757504 00000100:00100000:3.0:1789596607.203362:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964757504 00000100:00100000:3.0:1789596607.203399:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789596607.203406:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:6690:x1876527964757504:12345-0@lo:502: 00000100:00100000:3.0:1789596607.203530:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:6690:x1876527964757504:12345-0@lo:502: Request processed in 125us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596607.203537:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789596607.204243:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964757504:0@lo:502: 00000040:00080000:1.0:1789596607.204372:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789596607.204385:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789596607.206107:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596607.206120:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596607.206122:0:6714:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789596607.206129:0:6714:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ea8f9e94000 00000020:00000080:0.0:1789596607.206132:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789596607.206152:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596607.206155:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596607.206157:0:6714:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789596607.206160:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789596607.206300:0:6690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789596607.206322:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789596607.206346:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d778f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7796 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.206358:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d778f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7796 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596607.206398:0:6690:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789596607.206401:0:6690:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ea8f9e94000 10000000:01000000:1.0:1789596607.206404:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ea8f9e94000 10000000:01000000:1.0:1789596607.206408:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789596607.206413:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ea8f9e94000 from 1 10000000:01000000:1.0:1789596607.206416:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789596607.206451:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d779d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.206460:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d779d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.206469:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d779d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596607.206491:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964757632:0@lo:101: 00000100:00100000:1.0:1789596607.206558:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596607.206756:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c905cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789596607.206965:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964757632 00000100:00100000:3.0:1789596607.206972:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964757632 00000100:00100000:3.0:1789596607.207014:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789596607.207023:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:6690:x1876527964757632:12345-0@lo:101: 00010000:00010000:3.0:1789596607.207035:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596607.207048:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea902045a00/0x8973ae90b38d77a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d779d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596607.207071:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea902045a00/0x8973ae90b38d77a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d779d expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596607.207081:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea902045a00/0x8973ae90b38d77a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d779d expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596607.207089:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea902045a00, rc 0) 00000100:00100000:3.0:1789596607.207128:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:6690:x1876527964757632:12345-0@lo:101: Request processed in 106us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596607.207148:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789596607.207244:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964757632:0@lo:101: 00010000:00010000:1.0:1789596607.207259:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d779d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d77a4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.207274:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d779d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d77a4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596607.207361:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964757760:0@lo:501: 00000100:00100000:1.0:1789596607.207389:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596607.207413:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c905cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789596607.207507:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964757760 00000100:00100000:3.0:1789596607.207512:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964757760 00000100:00100000:3.0:1789596607.207545:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789596607.207552:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:6690:x1876527964757760:12345-0@lo:501: 00000100:00100000:3.0:1789596607.208702:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:6690:x1876527964757760:12345-0@lo:501: Request processed in 1146us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596607.208712:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789596607.209475:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964757760:0@lo:501: 00000100:00100000:1.0:1789596607.209568:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964757888:0@lo:503: 00000100:00100000:1.0:1789596607.209779:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596607.210344:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c905cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596607.210383:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964757888 00000100:00100000:0.0:1789596607.210392:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964757888 00000100:00100000:0.0:1789596607.210479:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789596607.210488:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:6690:x1876527964757888:12345-0@lo:503: 00000100:00100000:0.0:1789596607.210962:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:6690:x1876527964757888:12345-0@lo:503: Request processed in 321us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596607.210971:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789596607.211460:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964757888:0@lo:503: 00000040:00080000:1.0:1789596607.212197:0:6690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789596607.212294:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964758016:0@lo:502: 00000100:00100000:1.0:1789596607.212344:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596607.212424:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c905cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596607.212487:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964758016 00000100:00100000:0.0:1789596607.212493:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964758016 00000100:00100000:0.0:1789596607.212537:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789596607.212546:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:6690:x1876527964758016:12345-0@lo:502: 00000100:00100000:0.0:1789596607.213004:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:6690:x1876527964758016:12345-0@lo:502: Request processed in 459us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596607.213013:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789596607.213287:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5781880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964758016:0@lo:502: 00000040:00080000:2.0:1789596607.213556:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789596607.213747:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789596607.213789:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789596607.214175:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789596607.214217:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789596607.214280:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789596607.214320:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789596607.214350:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789596607.214395:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789596607.214428:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789596607.214459:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789596607.214504:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789596607.214538:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789596607.214568:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789596607.214776:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789596607.215152:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789596607.215209:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789596607.215261:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789596607.215298:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789596607.215329:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789596607.215375:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789596607.215409:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789596607.215442:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789596607.215488:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789596607.215524:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789596607.215557:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789596607.215642:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789596607.222222:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1789596607.222303:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964758144:0@lo:502: 00000100:00100000:3.0:1789596607.222390:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596607.222469:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d1052900 going to sleep for 11 seconds 00000100:00100000:0.0:1789596607.222567:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964758144 00000100:00100000:0.0:1789596607.222644:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964758144 00000100:00100000:0.0:1789596607.222803:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789596607.223053:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:6690:x1876527964758144:12345-0@lo:502: 00000100:00100000:0.0:1789596607.223340:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:6690:x1876527964758144:12345-0@lo:502: Request processed in 291us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596607.223348:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789596607.224085:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964758144:0@lo:502: 00000040:00080000:3.0:1789596607.224223:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789596607.224237:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789596607.225335:0:6715:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789596607.225351:0:6715:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ea8f7458000) 00000020:00000080:3.0:1789596607.225372:0:6715:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1789596607.225450:0:6715:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ea8f9e94000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789596607.225454:0:6715:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ea8f9e94000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789596607.225457:0:6715:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ea8f9e94000 3 00010000:00080000:3.0:1789596607.225648:0:6715:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ea8ff349800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.144@tcp at head 00010000:00010000:3.0:1789596607.229410:0:6715:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1789596607.230652:0:6715:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789596607.230702:0:6715:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789596607.230715:0:6715:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8973ae90b38d77b2 00000100:00080000:3.0:1789596607.230727:0:6715:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789596607.230744:0:6715:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ea8ff349800 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:3.0:1789596607.230783:0:6715:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ea8c6ec1500 x1876527964758272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789596607.230803:0:6715:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789596607.233353:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876527964758272:0@lo:38: 00000100:00100000:1.0:1789596607.233431:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596607.233557:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964758272 00000100:00100000:3.0:1789596607.233565:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964758272 00000100:00100000:3.0:1789596607.233929:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789596607.233937:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876527964758272:12345-0@lo:38: 00010000:00080000:3.0:1789596607.233975:0:5843:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:3.0:1789596607.234024:0:5843:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8973ae90b38d77b9 00000004:00100000:3.0:1789596607.234039:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789596607.234072:0:5843:0:(import.c:65:import_set_state_nolock()) ffff9ea8ff5bb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789596607.234129:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876527964758272:12345-0@lo:38: Request processed in 191us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596607.234137:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789596607.237105:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964758400:0@lo:400: 00000100:00100000:2.0:1789596607.237175:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789596607.238023:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ea8c6ec1500 x1876527964758272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789596617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596607.238035:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789596607.238046:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789596607.238055:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789596607.238060:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789596607.238064:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8ff349800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789596607.238078:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876527964758272:0@lo:38: 00000040:00080000:1.0:1789596607.238235:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1789596607.238338:0:6690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789596607.238366:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789596607.238381:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d779d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d77a4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596607.238392:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d779d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d77a4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789596607.238437:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789596607.238439:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789596607.238440:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789596607.238441:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789596607.238442:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789596607.238444:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789596607.238445:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789596607.238447:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789596607.238448:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789596607.238450:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789596607.238451:0:6690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789596607.238455:0:6690:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789596607.238457:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789596607.238459:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789596607.238460:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789596607.238461:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789596607.238462:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789596607.238463:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789596607.238464:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789596607.238465:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789596607.238466:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789596607.238467:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789596607.238468:0:6690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789596607.238487:0:6690:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789596607.238499:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5781f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964758528:0@lo:253: 00000100:00100000:1.0:1789596607.238563:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596607.238600:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c905ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596607.240238:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964758400 00000100:00100000:3.0:1789596607.240251:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964758400 00000100:00100000:3.0:1789596607.240307:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789596607.240316:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964758400:12345-0@lo:400: 00000100:00100000:3.0:1789596607.240404:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964758400:12345-0@lo:400: Request processed in 89us (3229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596607.240411:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789596607.240437:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964758528 00000100:00100000:3.0:1789596607.240442:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964758528 00000100:00100000:3.0:1789596607.240468:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789596607.240475:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:6690:x1876527964758528:12345-0@lo:253: 20000000:01000000:3.0:1789596607.240496:0:5836:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789596607.240517:0:5836:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1789596607.242229:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ea8fa252680 x1876527964758400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596607.242247:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964758400:0@lo:400: 20000000:01000000:0.0:1789596607.266586:0:5836:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789596607.266600:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789596607.266631:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789596607.266636:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789596607.266658:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ea8c0030e00/0x8973ae90b38d77c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.266689:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d771f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7718 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.266698:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ea8c0030e00/0x8973ae90b38d77c0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.266740:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d771f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d7718 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.266769:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d771f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d7718 expref: 13 pid: 5834 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596607.266783:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa252300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1876527964758656:0@lo:104: 00000100:00100000:0.0:1789596607.266880:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596607.266928:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c5ba3000 going to sleep for 11 seconds 00000100:00100000:0.0:1789596607.266976:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964758656 00000100:00100000:0.0:1789596607.266983:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964758656 00000100:00100000:0.0:1789596607.267033:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789596607.267042:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa252a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:5857:x1876527964758656:12345-0@lo:104: 00010000:00010000:0.0:1789596607.267055:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea902044600/0x8973ae90b38d7718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d771f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.267104:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789596607.267109:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa252a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:5857:x1876527964758656:12345-0@lo:104: Request processed in 69us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596607.267116:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789596607.267173:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa252300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1876527964758656:0@lo:104: 00010000:00010000:0.0:1789596607.267192:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ea8c0030e00/0x8973ae90b38d77c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.267362:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596607.267368:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea902044600/0x8973ae90b38d7718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d771f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.267375:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea902044600 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:0.0:1789596607.267380:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea902044600/0x8973ae90b38d7718 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d771f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.267397:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea902044600/0x8973ae90b38d7718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d771f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596607.267404:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea902044600/0x8973ae90b38d7718 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d771f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596607.267411:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789596607.267436:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea902044600/0x8973ae90b38d7718 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d771f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.267442:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789596607.267460:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea902044600/0x8973ae90b38d7718 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d771f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.267467:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea902044600/0x8973ae90b38d7718 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d771f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.267487:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596607.267489:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596607.267491:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596607.267653:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964758784:0@lo:103: 00000100:00100000:0.0:1789596607.267686:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596607.267750:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964758784 00000100:00100000:0.0:1789596607.267755:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964758784 00010000:00010000:0.0:1789596607.267770:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d771f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d7718 expref: 14 pid: 5834 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596607.267791:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789596607.267797:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c8280850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:3307:x1876527964758784:12345-0@lo:103: 00010000:00010000:0.0:1789596607.267836:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596607.267843:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d771f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d7718 expref: 14 pid: 5834 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.267854:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d771f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d7718 expref: 14 pid: 5834 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.267866:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d771f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d7718 expref: 14 pid: 5834 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.267879:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ea8c0030e00/0x8973ae90b38d77c0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.267888:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c0030e00/0x8973ae90b38d77c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789596607.267901:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001958606s 00010000:00010000:0.0:1789596607.267906:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8c0030e00/0x8973ae90b38d77c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.267912:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8c0030e00/0x8973ae90b38d77c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.267918:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ea8c0030e00/0x8973ae90b38d77c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.267924:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ea8c0030e00/0x8973ae90b38d77c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.267930:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030e00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596607.267934:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ea8c0030e00/0x8973ae90b38d77c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.267961:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ea8c0030e00/0x8973ae90b38d77c0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.267977:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ea8c0030e00/0x8973ae90b38d77c0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.267986:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596607.269496:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596607.269864:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c8280850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:3307:x1876527964758784:12345-0@lo:103: Request processed in 2061us (2172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596607.269875:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789596607.269959:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ea8c0030e00/0x8973ae90b38d77c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.269970:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ea8c0030e00/0x8973ae90b38d77c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596607.269976:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8c0030e00/0x8973ae90b38d77c0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596607.270019:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964758784:0@lo:103: 00000100:00100000:0.0:1789596607.282369:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:6690:x1876527964758528:12345-0@lo:253: Request processed in 41877us (43789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596607.282383:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789596607.282523:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5781f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:6690:1876527964758528:0@lo:253: 10000000:01000000:1.0:1789596607.282538:0:6690:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789596607.282541:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789596607.282543:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789596607.282544:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789596607.282545:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789596607.282546:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789596607.282547:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789596607.282549:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789596607.282551:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789596607.282552:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789596607.282553:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789596607.282555:0:6690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789596607.282580:0:6690:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789596607.287916:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789596607.288265:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789596607.288547:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789596607.288858:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789596607.289436:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789596607.289980:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789596607.292145:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789596607.695444:0:6690:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789596607.695452:0:6690:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789596607.695487:0:6690:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789596607.695549:0:6690:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.144@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789596607.695566:0:6690:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789596607.695592:0:6690:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789596608.283280:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596609.307080:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596610.332577:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596611.354944:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789596612.130195:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789596612.130202:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ea8e4942800 from 21 10000000:01000000:0.0:1789596612.130208:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789596612.130253:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030800/0x8973ae90b38d77c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596612.130279:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030800/0x8973ae90b38d77c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596612.130291:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030800/0x8973ae90b38d77c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596612.130314:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964758912:0@lo:101: 00000100:00100000:0.0:1789596612.130471:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596612.130512:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6a039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596612.130535:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964758912 00000100:00100000:0.0:1789596612.130542:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964758912 00000100:00100000:0.0:1789596612.130588:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789596612.130596:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5838:x1876527964758912:12345-0@lo:101: 00010000:00010000:0.0:1789596612.130610:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596612.130625:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d77ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d77c7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596612.130647:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d77ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d77c7 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596612.130657:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d77ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d77c7 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596612.130666:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0031000, rc 0) 00000100:00100000:0.0:1789596612.130702:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:5838:x1876527964758912:12345-0@lo:101: Request processed in 107us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596612.130707:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789596612.130749:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964758912:0@lo:101: 00010000:00010000:0.0:1789596612.130768:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030800/0x8973ae90b38d77c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d77ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596612.130777:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030800/0x8973ae90b38d77c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d77ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596612.130849:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964759040:0@lo:501: 00000100:00100000:0.0:1789596612.130875:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596612.130893:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6a039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596612.130929:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964759040 00000100:00100000:0.0:1789596612.130933:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964759040 00000100:00100000:0.0:1789596612.130954:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789596612.130960:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:5838:x1876527964759040:12345-0@lo:501: 00000100:00100000:0.0:1789596612.132328:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:5838:x1876527964759040:12345-0@lo:501: Request processed in 1361us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596612.132338:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789596612.132563:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964759040:0@lo:501: 00000100:00100000:0.0:1789596612.132601:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964759168:0@lo:503: 00000100:00100000:0.0:1789596612.132649:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596612.132677:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6a039c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596612.132759:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964759168 00000100:00100000:3.0:1789596612.132765:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964759168 00000100:00100000:3.0:1789596612.132802:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789596612.132810:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:5838:x1876527964759168:12345-0@lo:503: 00000100:00100000:3.0:1789596612.132987:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:5838:x1876527964759168:12345-0@lo:503: Request processed in 178us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596612.132994:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789596612.133029:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964759168:0@lo:503: 00000100:00100000:1.0:1789596612.148109:0:6995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5781f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:6995:1876527964759296:0@lo:502: 00000100:00100000:1.0:1789596612.148250:0:6995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596612.148312:0:6995:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c80cee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596612.148508:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964759296 00000100:00100000:0.0:1789596612.148516:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964759296 00000100:00100000:0.0:1789596612.148564:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789596612.148572:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:6995:x1876527964759296:12345-0@lo:502: 00000100:00100000:0.0:1789596612.148807:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:6995:x1876527964759296:12345-0@lo:502: Request processed in 235us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596612.148833:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789596612.148944:0:6995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5781f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:6995:1876527964759296:0@lo:502: 00000100:00100000:1.0:1789596612.148997:0:6995:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5781f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:6995:1876527964759424:0@lo:502: 00000100:00100000:1.0:1789596612.149030:0:6995:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596612.149056:0:6995:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c80cee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596612.149236:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964759424 00000100:00100000:0.0:1789596612.149241:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964759424 00000100:00100000:0.0:1789596612.149273:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789596612.149280:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:6995:x1876527964759424:12345-0@lo:502: 00000100:00100000:0.0:1789596612.151103:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:6995:x1876527964759424:12345-0@lo:502: Request processed in 1817us (2066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596612.151115:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789596612.151833:0:6995:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5781f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:6995:1876527964759424:0@lo:502: 00000040:00080000:1.0:1789596612.151876:0:6995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789596612.152218:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789596612.152240:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789596612.152250:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030800/0x8973ae90b38d77c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d77ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596612.152261:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030800/0x8973ae90b38d77c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d77ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596612.152271:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789596612.152273:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ea8e4942800 from 4 10000000:01000000:0.0:1789596612.152276:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789596612.152308:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030a00/0x8973ae90b38d77d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596612.152315:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030a00/0x8973ae90b38d77d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596612.152325:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030a00/0x8973ae90b38d77d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596612.152352:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa251c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964759552:0@lo:101: 00000100:00100000:0.0:1789596612.152395:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596612.152970:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea7c2c93f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596612.156370:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964759552 00000100:00100000:1.0:1789596612.156384:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964759552 00000100:00100000:1.0:1789596612.156445:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789596612.156455:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:5838:x1876527964759552:12345-0@lo:101: 00010000:00010000:1.0:1789596612.156471:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596612.156491:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d77dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d77d5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596612.156516:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d77dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d77d5 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596612.156528:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d77dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d77d5 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596612.156537:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea9021f9200, rc 0) 00000100:00100000:1.0:1789596612.156607:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:5838:x1876527964759552:12345-0@lo:101: Request processed in 154us (4212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596612.156614:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789596612.156663:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa251c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964759552:0@lo:101: 00010000:00010000:1.0:1789596612.156679:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030a00/0x8973ae90b38d77d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d77dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596612.156688:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030a00/0x8973ae90b38d77d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d77dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596612.156752:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5781f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964759680:0@lo:256: 00000100:00100000:1.0:1789596612.156794:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596612.156839:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c80cecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596612.156853:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964759680 00000100:00100000:1.0:1789596612.156857:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964759680 00000100:00100000:1.0:1789596612.156880:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789596612.156887:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:5838:x1876527964759680:12345-0@lo:256: 20000000:01000000:1.0:1789596612.156909:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789596612.156926:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789596612.156929:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789596612.157015:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:5838:x1876527964759680:12345-0@lo:256: Request processed in 128us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596612.157022:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789596612.157295:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5781f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964759680:0@lo:256: 10000000:01000000:2.0:1789596612.157349:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789596612.157357:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030a00/0x8973ae90b38d77d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d77dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596612.157365:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030a00/0x8973ae90b38d77d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d77dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596612.157373:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789596612.157376:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789596612.157378:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789596612.157397:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d77e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596612.157403:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d77e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596612.157412:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d77e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596612.157432:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964759808:0@lo:101: 00000100:00100000:2.0:1789596612.157458:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596612.157485:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c813c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596612.161443:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964759808 00000100:00100000:1.0:1789596612.161459:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964759808 00000100:00100000:1.0:1789596612.161523:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789596612.161534:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:5838:x1876527964759808:12345-0@lo:101: 00010000:00010000:1.0:1789596612.161548:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596612.161566:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea9021f8600/0x8973ae90b38d77ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d77e3 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596612.161592:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea9021f8600/0x8973ae90b38d77ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d77e3 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596612.161602:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea9021f8600/0x8973ae90b38d77ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d77e3 expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596612.161611:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea9021f8600, rc 0) 00000100:00100000:1.0:1789596612.161682:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:5838:x1876527964759808:12345-0@lo:101: Request processed in 150us (4223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596612.161704:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789596612.161755:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964759808:0@lo:101: 00010000:00010000:1.0:1789596612.161772:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d77e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d77ea expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596612.161781:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d77e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d77ea expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596612.161859:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5783100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964759936:0@lo:501: 00000100:00100000:1.0:1789596612.161888:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596612.161916:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c80cecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596612.161930:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964759936 00000100:00100000:1.0:1789596612.161933:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964759936 00000100:00100000:1.0:1789596612.161950:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789596612.161955:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:5838:x1876527964759936:12345-0@lo:501: 00000100:00100000:1.0:1789596612.163324:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:5838:x1876527964759936:12345-0@lo:501: Request processed in 1362us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596612.163335:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789596612.163399:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5783100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964759936:0@lo:501: 00000100:00100000:1.0:1789596612.163441:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5783100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964760064:0@lo:503: 00000100:00100000:1.0:1789596612.163479:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596612.163521:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c80cecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596612.163579:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964760064 00000100:00100000:2.0:1789596612.163585:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964760064 00000100:00100000:2.0:1789596612.163620:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789596612.163627:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:5838:x1876527964760064:12345-0@lo:503: 00000100:00100000:2.0:1789596612.163884:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:5838:x1876527964760064:12345-0@lo:503: Request processed in 257us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596612.163891:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789596612.164642:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5783100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964760064:0@lo:503: 00000100:00100000:1.0:1789596612.165472:0:6996:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5783100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:6996:1876527964760192:0@lo:502: 00000100:00100000:1.0:1789596612.165527:0:6996:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596612.165566:0:6996:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c80ce180 going to sleep for 11 seconds 00000100:00100000:2.0:1789596612.165931:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964760192 00000100:00100000:2.0:1789596612.165938:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964760192 00000100:00100000:2.0:1789596612.165975:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789596612.165984:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:6996:x1876527964760192:12345-0@lo:502: 00000100:00100000:2.0:1789596612.166234:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:6996:x1876527964760192:12345-0@lo:502: Request processed in 251us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596612.166243:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789596612.167348:0:6996:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5783100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:6996:1876527964760192:0@lo:502: 00000020:01000000:1.0:1789596612.167385:0:6996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789596612.167393:0:6996:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789596612.167402:0:6996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596612.167404:0:6996:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789596612.167408:0:6996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789596612.167412:0:6996:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.144@tcp to nid 0x20000c0a8ca90 (192.168.202.144@tcp) 00000020:01000000:1.0:1789596612.167435:0:6996:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789596612.167437:0:6996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789596612.167451:0:6996:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ea8c6e219c0) 00000020:00000080:1.0:1789596612.167470:0:6996:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789596612.167475:0:6996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789596612.167552:0:6996:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789596612.167558:0:6996:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789596612.167564:0:6996:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8973ae90b38d77f8 00010000:00080000:1.0:1789596612.167592:0:6996:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ea8ff34d000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.144@tcp at head 00010000:00010000:1.0:1789596612.167838:0:6996:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789596612.238393:0:6996:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789596612.238412:0:6996:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789596612.238813:0:6996:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789596612.239016:0:6996:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789596612.239064:0:6996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789596612.239118:0:6996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789596612.242359:0:6999:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789596612.242368:0:6999:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789596612.244282:0:6996:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789596612.244297:0:6996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789596612.244333:0:6996:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789596612.244353:0:6996:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8973ae90b38d77ff 00000100:00080000:0.0:1789596612.244362:0:6996:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789596612.244374:0:6996:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ea8ff34d000 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:0.0:1789596612.244486:0:6996:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ea8fa251500 x1876527964760320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789596612.244516:0:6996:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789596612.244570:0:6996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596612.244575:0:6996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596612.244577:0:6996:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789596612.244580:0:6996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596612.244584:0:6996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596612.244585:0:6996:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789596612.244588:0:6996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789596612.244590:0:6996:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789596612.244616:0:6996:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:6996:1876527964760448:0@lo:502: 00000100:00100000:3.0:1789596612.244656:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964760576:0@lo:400: 00000100:00100000:2.0:1789596612.244734:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964760320:0@lo:8: 00000100:00100000:3.0:1789596612.244749:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596612.244767:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596612.244806:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596612.244812:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964760704:0@lo:400: 00000100:00100000:3.0:1789596612.244857:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596612.244857:0:6996:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596612.244912:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964760576 00000100:00100000:3.0:1789596612.244919:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964760576 00000100:00100000:3.0:1789596612.244955:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964760704 00000100:00100000:3.0:1789596612.244958:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964760704 00000100:00100000:3.0:1789596612.244989:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789596612.244996:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964760576:12345-0@lo:400: 00000100:00100000:0.0:1789596612.245022:0:6996:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea7c2c93780 going to sleep for 11 seconds 00000100:00100000:3.0:1789596612.245051:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964760576:12345-0@lo:400: Request processed in 55us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596612.245064:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789596612.245078:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789596612.245083:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964760704:12345-0@lo:400: 00010000:00080000:2.0:1789596612.245086:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8c6ec0000 x1876527964760576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596612.245098:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964760576:0@lo:400: 00000100:00100000:3.0:1789596612.245107:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964760704:12345-0@lo:400: Request processed in 25us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596612.245113:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789596612.245131:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8c6ec3800 x1876527964760704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596612.245133:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964760320 00000100:00100000:3.0:1789596612.245136:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964760320 00000100:00100000:2.0:1789596612.245147:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964760704:0@lo:400: 00000100:00100000:3.0:1789596612.245151:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789596612.245155:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1876527964760320:12345-0@lo:8: 00010000:00080000:3.0:1789596612.245173:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000100:00100000:1.0:1789596612.246004:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964760448 00000100:00100000:1.0:1789596612.246012:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964760448 00000100:00100000:1.0:1789596612.246100:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789596612.246109:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:6996:x1876527964760448:12345-0@lo:502: 00000020:00000080:3.0:1789596612.246284:0:6692:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8973ae90b38d7806 00002000:00100000:3.0:1789596612.246317:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ea8ff5bc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789596612.246322:0:6692:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1789596612.246326:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789596612.246337:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:6996:x1876527964760448:12345-0@lo:502: Request processed in 231us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596612.246352:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00002000:00100000:3.0:1789596612.246430:0:6692:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1789596612.246445:0:6996:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:6996:1876527964760448:0@lo:502: 00000020:01000000:0.0:1789596612.246472:0:6996:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596612.246477:0:6996:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596612.246479:0:6996:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789596612.246483:0:6996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00002000:00080000:3.0:1789596612.246556:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789596612.246577:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9ea8ff5be800 : changing import state from RECOVER to FULL 00000020:01000000:0.0:1789596612.246596:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789596612.246611:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:3.0:1789596612.246615:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876527964760320:12345-0@lo:8: Request processed in 1459us (1847us total) trans 0 rc 0/0 00010000:00010000:0.0:1789596612.246620:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d77e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d77ea expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596612.246621:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789596612.246646:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789596612.246653:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d77e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d77ea expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596612.246663:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789596612.246666:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ea8c2ca3380 from 1 10000000:01000000:0.0:1789596612.246669:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00080000:3.0:1789596612.246678:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8fa251500 x1876527964760320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789596622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596612.246686:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789596612.246692:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00010000:00010000:0.0:1789596612.246693:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d780d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596612.246700:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d780d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789596612.246702:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789596612.246707:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789596612.246709:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8ff34d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00010000:00010000:0.0:1789596612.246709:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d780d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789596612.246721:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789596612.246723:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964760832:0@lo:101: 00000100:00100000:3.0:1789596612.246725:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964760320:0@lo:8: 00000004:00080000:3.0:1789596612.246744:0:6999:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789596612.246751:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789596612.246847:0:6999:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 197211030075ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789596612.247676:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964760832 00000100:00100000:2.0:1789596612.247684:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964760832 00000100:00100000:2.0:1789596612.247712:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789596612.247722:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:5838:x1876527964760832:12345-0@lo:101: 00010000:00010000:2.0:1789596612.247735:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596612.247749:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8c1482400/0x8973ae90b38d7814 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d780d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596612.247770:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c1482400/0x8973ae90b38d7814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d780d expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596612.247782:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8c1482400/0x8973ae90b38d7814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d780d expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596612.247791:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c1482400, rc 0) 00000100:00100000:2.0:1789596612.247853:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:5838:x1876527964760832:12345-0@lo:101: Request processed in 135us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596612.247859:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789596612.260578:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea7c2c93780 going to sleep for 11 seconds 00000100:00100000:0.0:1789596612.260619:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964760832:0@lo:101: 00010000:00010000:0.0:1789596612.260656:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d780d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7814 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596612.260670:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d780d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7814 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596612.260739:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964760960:0@lo:501: 00000100:00100000:0.0:1789596612.260795:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596612.260875:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea7c2c93780 going to sleep for 11 seconds 00000100:00100000:0.0:1789596612.260891:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964760960 00000100:00100000:0.0:1789596612.260897:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964760960 00000100:00100000:0.0:1789596612.260947:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789596612.260957:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:5838:x1876527964760960:12345-0@lo:501: 00000100:00100000:0.0:1789596612.261729:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:5838:x1876527964760960:12345-0@lo:501: Request processed in 770us (930us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789596612.261737:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789596612.261780:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964760960:0@lo:501: 10000000:01000000:0.0:1789596612.261804:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789596612.261811:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d780d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7814 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596612.261850:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d780d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7814 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789596612.339086:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789596612.381177:0:7000:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789596612.381350:0:7000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7000:1876527964761216:0@lo:7: 00000100:00100000:3.0:1789596612.381415:0:7000:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596612.381496:0:7000:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff869e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596612.381527:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964761088:0@lo:13: 00000100:00100000:3.0:1789596612.381552:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596612.381589:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964761088 00000100:00100000:1.0:1789596612.381597:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964761088 00000100:00100000:1.0:1789596612.381653:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789596612.381662:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876527964761088:12345-0@lo:13: 00002000:00000024:1.0:1789596612.381692:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789596612.381740:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876527964761088:12345-0@lo:13: Request processed in 79us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596612.381746:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789596612.381803:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8c6ec1880 x1876527964761088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596612.381841:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964761088:0@lo:13: 00000100:00080000:3.0:1789596612.382334:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596612.385987:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964761216 00000100:00100000:2.0:1789596612.386005:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964761216 00000100:00100000:2.0:1789596612.386059:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789596612.386070:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7000:x1876527964761216:12345-0@lo:7: 00002000:00080000:2.0:1789596612.402974:0:6695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789596612.402984:0:6695:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789596612.403075:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7000:x1876527964761216:12345-0@lo:7: Request processed in 17002us (21655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596612.403094:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789596612.403224:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1789596612.403471:0:7000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8c6ec0700 x1876527964761216/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789596628 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596612.403486:0:7000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7000:1876527964761216:0@lo:7: 00000004:00080000:0.0:1789596612.403499:0:7000:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789596612.403535:0:7000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa250000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7000:1876527964761344:0@lo:5: 00000100:00100000:0.0:1789596612.403566:0:7000:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596612.403613:0:7000:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea7c2c93780 going to sleep for 11 seconds 00000100:00100000:2.0:1789596612.404394:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964761344 00000100:00100000:2.0:1789596612.404402:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964761344 00000100:00100000:2.0:1789596612.404451:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789596612.404460:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7000:x1876527964761344:12345-0@lo:5: 00002000:00080000:2.0:1789596612.404487:0:6692:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789596612.404490:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789596612.404862:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7000:x1876527964761344:12345-0@lo:5: Request processed in 403us (1295us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789596612.404870:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789596612.404933:0:7000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8fa250000 x1876527964761344/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789596628 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596612.404946:0:7000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa250000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7000:1876527964761344:0@lo:5: 00000004:00080000:0.0:1789596612.404964:0:7000:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789596612.404991:0:7000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa251180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7000:1876527964761472:0@lo:700: 00000100:00100000:0.0:1789596612.405019:0:7000:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596612.405046:0:7000:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea7c2c93780 going to sleep for 11 seconds 00000100:00100000:3.0:1789596612.405080:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964761472 00000100:00100000:3.0:1789596612.405085:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964761472 00000100:00100000:3.0:1789596612.405150:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789596612.405157:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7000:x1876527964761472:12345-0@lo:700: 00000100:00100000:3.0:1789596612.405768:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6701:1876527964761600:0@lo:700: 00000100:00100000:3.0:1789596612.405799:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596612.405849:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff869c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789596612.405857:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964761600 00000100:00100000:0.0:1789596612.405862:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964761600 00000100:00100000:0.0:1789596612.405887:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789596612.405894:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6701:x1876527964761600:12345-0@lo:700: 40000000:02000000:1.0:1789596612.478392:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1789596612.481550:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6701:x1876527964761600:12345-0@lo:700: Request processed in 75648us (75742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596612.481570:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789596612.485368:0:6701:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8c6ec1f80 x1876527964761600/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789596628 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596612.485387:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6701:1876527964761600:0@lo:700: 40000000:02000000:3.0:1789596612.485401:0:6701:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1789596612.602003:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1789596612.602038:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789596612.602259:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7000:x1876527964761472:12345-0@lo:700: Request processed in 197097us (197233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596612.602276:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789596612.602591:0:7000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8fa251180 x1876527964761472/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789596628 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596612.602603:0:7000:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789596612.602620:0:7000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa251180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7000:1876527964761472:0@lo:700: 00000004:02000040:3.0:1789596612.644296:0:7000:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1789596612.649031:0:7000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7000:1876527964761728:0@lo:5: 00000100:00100000:3.0:1789596612.649099:0:7000:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596612.649162:0:7000:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff869900 going to sleep for 11 seconds 00000100:00100000:1.0:1789596612.649243:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964761728 00000100:00100000:1.0:1789596612.649254:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964761728 00000100:00100000:1.0:1789596612.649346:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789596612.649356:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7000:x1876527964761728:12345-0@lo:5: 00002000:00080000:1.0:1789596612.658417:0:6695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789596612.658440:0:6695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1789596612.663196:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7000:x1876527964761728:12345-0@lo:5: Request processed in 13834us (14089us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789596612.663209:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789596612.665970:0:7000:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8c6ec1f80 x1876527964761728/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789596628 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596612.665992:0:7000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7000:1876527964761728:0@lo:5: 00000004:00080000:3.0:1789596612.666007:0:7000:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:02000400:1.0:1789596613.247264:0:7062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg244-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789596613.403373:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596614.428860:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596615.451037:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596616.475730:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596617.498987:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596617.760162:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964761984:0@lo:400: 00000100:00100000:0.0:1789596617.760263:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596617.760338:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596617.760346:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964762112:0@lo:400: 00000100:00100000:0.0:1789596617.760378:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596617.760657:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964762240:0@lo:400: 00000100:00100000:1.0:1789596617.760697:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596617.760727:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596617.760734:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964761856:0@lo:400: 00000100:00100000:1.0:1789596617.760768:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596617.760847:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964762240 00000100:00100000:1.0:1789596617.760865:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964762240 00000100:00100000:1.0:1789596617.760935:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789596617.760946:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1876527964762240:12345-0@lo:400: 00000100:00100000:1.0:1789596617.761007:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1876527964762240:12345-0@lo:400: Request processed in 63us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596617.761014:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789596617.761040:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596617.764388:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964761984 00000100:00100000:3.0:1789596617.764412:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964761984 00000100:00100000:3.0:1789596617.764482:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964762112 00000100:00100000:3.0:1789596617.764486:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964762112 00000100:00100000:3.0:1789596617.764527:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789596617.764537:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964761984:12345-0@lo:400: 00000100:00100000:3.0:1789596617.764680:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964761984:12345-0@lo:400: Request processed in 144us (4416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596617.764689:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789596617.764709:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789596617.764716:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964762112:12345-0@lo:400: 00000100:00100000:3.0:1789596617.764749:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964762112:12345-0@lo:400: Request processed in 34us (4370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596617.764755:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789596617.764864:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596617.764883:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964762368:0@lo:13: 00000100:00100000:3.0:1789596617.764949:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596617.765015:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964762368 00000100:00100000:3.0:1789596617.765020:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964762368 00000100:00100000:3.0:1789596617.765049:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789596617.765056:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876527964762368:12345-0@lo:13: 00002000:00000024:3.0:1789596617.765091:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596617.765131:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876527964762368:12345-0@lo:13: Request processed in 75us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596617.765138:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789596617.765183:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8c6ec0700 x1876527964762368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596617.765207:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964762368:0@lo:13: 00010000:00080000:3.0:1789596617.765242:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8fa250e00 x1876527964762112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596617.765253:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964762112:0@lo:400: 00010000:00080000:3.0:1789596617.765267:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8fa250700 x1876527964761984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596617.765275:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964761984:0@lo:400: 00000100:00100000:0.0:1789596617.765769:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964761856 00000100:00100000:0.0:1789596617.765777:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964761856 00000100:00100000:0.0:1789596617.765865:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789596617.765875:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:3306:x1876527964761856:12345-0@lo:400: 00000100:00100000:0.0:1789596617.765932:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:3306:x1876527964761856:12345-0@lo:400: Request processed in 60us (5164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596617.765940:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789596617.770572:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa251880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964761856:0@lo:400: 00010000:00080000:1.0:1789596617.770606:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8fa253480 x1876527964762240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596617.770623:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964762240:0@lo:400: 00000001:00080000:2.0:1789596617.882370:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1789596618.528402:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596619.548511:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596620.570976:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596621.595580:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596622.619040:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596622.881991:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964762496:0@lo:13: 00000100:00100000:1.0:1789596622.882061:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596622.882131:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964762496 00000100:00100000:1.0:1789596622.882140:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964762496 00000100:00100000:1.0:1789596622.882209:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789596622.882217:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964762496:12345-0@lo:13: 00002000:00000024:1.0:1789596622.882251:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789596622.882308:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964762496:12345-0@lo:13: Request processed in 91us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596622.882315:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789596622.882340:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789596622.882375:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8c5780380 x1876527964762496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596638 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596622.882387:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789596622.882406:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964762496:0@lo:13: 00000100:00100000:3.0:1789596622.897028:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596622.897051:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964762624:0@lo:400: 00000100:00100000:3.0:1789596622.897119:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596622.897163:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964762752:0@lo:400: 00000100:00100000:3.0:1789596622.897193:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596622.897210:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596622.897215:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964762880:0@lo:400: 00000100:00100000:3.0:1789596622.897247:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596622.897291:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964762624 00000100:00100000:3.0:1789596622.897299:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964762624 00000100:00100000:3.0:1789596622.897346:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789596622.897355:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:3308:x1876527964762624:12345-0@lo:400: 00000100:00100000:3.0:1789596622.897400:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:3308:x1876527964762624:12345-0@lo:400: Request processed in 46us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596622.897407:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789596622.897438:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964762752 00000100:00100000:3.0:1789596622.897442:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964762752 00000100:00100000:3.0:1789596622.897463:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964762880 00000100:00100000:3.0:1789596622.897466:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964762880 00000100:00100000:3.0:1789596622.897488:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789596622.897495:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964762752:12345-0@lo:400: 00000100:00100000:3.0:1789596622.897527:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964762752:12345-0@lo:400: Request processed in 33us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596622.897544:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789596622.897558:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789596622.897564:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964762880:12345-0@lo:400: 00000100:00100000:3.0:1789596622.897592:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964762880:12345-0@lo:400: Request processed in 29us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596622.897597:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789596622.897635:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964762624:0@lo:400: 00000100:00080000:3.0:1789596622.897655:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789596622.897671:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8c6ec0000 x1876527964762880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596622.897682:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964762880:0@lo:400: 00010000:00080000:3.0:1789596622.897701:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8c6ec3800 x1876527964762752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596622.897710:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964762752:0@lo:400: 00010000:00010000:2.0:1789596623.643099:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789596624.234197:0:7636:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789596624.234201:0:7636:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789596624.234341:0:7636:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ea8f66d1800 00000020:01000004:3.0:1789596624.234356:0:7636:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789596624.234367:0:7636:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789596624.234389:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ea8f66f0000) 00000020:00000080:3.0:1789596624.234404:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789596624.264327:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789596624.264846:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789596624.308505:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789596624.317410:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789596624.317444:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789596624.317511:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789596624.317553:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789596624.317941:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789596624.317953:0:7636:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789596624.317964:0:7636:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8973ae90b38d7822 00000020:01000004:2.0:1789596624.317971:0:7636:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789596624.317993:0:7636:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.144@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789596624.317997:0:7636:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789596624.318003:0:7636:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789596624.318023:0:7636:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789596624.318028:0:7636:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.144@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789596624.336742:0:7636:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.144@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789596624.336782:0:7636:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.144@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789596624.336786:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789596624.336797:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789596624.336799:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596624.336800:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596624.336801:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596624.336803:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596624.336804:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789596624.336806:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789596624.336807:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789596624.336809:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596624.336810:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789596624.336886:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789596624.336889:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789596624.336891:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789596624.336892:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596624.336893:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596624.336894:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596624.336895:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596624.336896:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789596624.336897:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789596624.336898:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789596624.336899:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596624.336900:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789596624.336942:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789596624.336964:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964763008:0@lo:253: 00000100:00100000:3.0:1789596624.337033:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596624.337295:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c56d3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789596624.337353:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964763008 00000100:00100000:1.0:1789596624.337361:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964763008 00000100:00100000:1.0:1789596624.338150:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789596624.338164:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:7636:x1876527964763008:12345-0@lo:253: 20000000:01000000:1.0:1789596624.338198:0:5836:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789596624.338202:0:5836:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1789596624.338208:0:5836:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1789596624.338212:0:5836:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789596624.339386:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789596624.339738:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789596624.339753:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789596624.339949:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1789596624.339959:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789596624.339992:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1789596624.340051:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1789596624.340408:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1789596624.340428:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.144@tcp 20000000:01000000:1.0:1789596624.340430:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.144@tcp (null) (null) (null) 00000040:00080000:1.0:1789596624.340462:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1789596624.340469:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789596624.340515:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789596624.340656:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.144@tcp (null) (null) 00000040:00080000:1.0:1789596624.340702:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789596624.340712:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789596624.340743:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789596624.340805:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789596624.341727:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1789596624.341749:0:5836:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.144@tcp 20000000:01000000:1.0:1789596624.341751:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.144@tcp (null) (null) (null) 00000040:00080000:1.0:1789596624.341786:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1789596624.341805:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789596624.341933:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1789596624.341942:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.144@tcp (null) (null) 00000040:00080000:1.0:1789596624.341989:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1789596624.341997:0:5836:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789596624.342041:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1789596624.342073:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1789596624.342087:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789596624.342089:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789596624.342093:0:5836:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789596624.342105:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789596624.342107:0:5836:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789596624.342139:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789596624.342141:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789596624.343987:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789596624.344056:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789596624.344112:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789596624.348250:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1789596624.348306:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1789596624.348339:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1789596624.348354:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789596624.348357:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789596624.351282:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1789596624.351386:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1789596624.351435:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1789596624.352245:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1789596624.352293:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1789596624.352349:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1789596624.352364:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789596624.352366:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789596624.354305:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789596624.354667:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789596624.354715:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789596624.355257:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1789596624.355280:0:5836:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789596624.355282:0:5836:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789596624.356424:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1789596624.356497:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1789596624.356777:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789596624.357157:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789596624.357202:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789596624.357261:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789596624.357278:0:5836:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1789596624.357280:0:5836:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1789596624.357289:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789596624.357310:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ea8d5f89c00/0x8973ae90b38d7829 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.357327:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d777a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7773 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.357334:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea902045a00/0x8973ae90b38d77a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d779d expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.357351:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d77ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d77c7 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.357357:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea9021f8600/0x8973ae90b38d77ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d77e3 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.357363:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8c1482400/0x8973ae90b38d7814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d780d expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.357370:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ea8d5f89c00/0x8973ae90b38d7829 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.357408:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8c1482400/0x8973ae90b38d7814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d780d expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.357422:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea8c1482400/0x8973ae90b38d7814 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d780d expref: 16 pid: 5834 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596624.357435:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876527964763136:0@lo:104: 00000100:00100000:3.0:1789596624.357498:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789596624.357800:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea9021f8600/0x8973ae90b38d77ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d77e3 expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.357810:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea9021f8600/0x8973ae90b38d77ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d77e3 expref: 16 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596624.357850:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876527964763264:0@lo:104: 00010000:00010000:3.0:1789596624.357880:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d77ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d77c7 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.357900:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d77ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d77c7 expref: 16 pid: 5834 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596624.357909:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876527964763392:0@lo:104: 00010000:00010000:3.0:1789596624.357934:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea902045a00/0x8973ae90b38d77a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d779d expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.357942:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea902045a00/0x8973ae90b38d77a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d779d expref: 16 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596624.357951:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876527964763520:0@lo:104: 00010000:00010000:3.0:1789596624.357969:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d777a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d7773 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.357976:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d777a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d7773 expref: 16 pid: 5834 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596624.357983:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876527964763648:0@lo:104: 00000100:00100000:3.0:1789596624.358000:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c56d3300 going to sleep for 11 seconds 00000100:00100000:0.0:1789596624.358115:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789596624.358135:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596624.358194:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596624.358300:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596624.358319:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964763136 00000100:00100000:2.0:1789596624.358326:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964763136 00000100:00100000:2.0:1789596624.358361:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964763264 00000100:00100000:2.0:1789596624.358363:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964763264 00000100:00100000:2.0:1789596624.358372:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964763392 00000100:00100000:2.0:1789596624.358375:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964763392 00000100:00100000:2.0:1789596624.358386:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789596624.358394:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8e6966050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+5:5836:x1876527964763136:12345-0@lo:104: 00010000:00010000:2.0:1789596624.358407:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d780d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7814 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.358745:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789596624.358753:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8e6966050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+5:5836:x1876527964763136:12345-0@lo:104: Request processed in 359us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596624.358762:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789596624.358859:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789596624.358867:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+4:5836:x1876527964763264:12345-0@lo:104: 00010000:00010000:2.0:1789596624.358875:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d77e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d77ea expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596624.358958:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876527964763136:0@lo:104: 00000100:00100000:3.0:1789596624.358966:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876527964763264:0@lo:104: 00000100:00100000:0.0:1789596624.359029:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596624.359037:0:5824:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:1.0:1789596624.359103:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789596624.359111:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d780d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7814 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.359117:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030200 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:1.0:1789596624.359122:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d780d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d7814 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.359131:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d780d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d7814 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596624.359144:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d780d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d7814 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596624.359150:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789596624.359205:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d780d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7814 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.359213:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789596624.359261:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964763776:0@lo:103: 00000100:00100000:3.0:1789596624.359295:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789596624.359347:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d780d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7814 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.359355:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d780d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7814 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.359371:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789596624.359375:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d77e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d77ea expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.359381:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483200 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:1.0:1789596624.359384:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d77e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d77ea expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.359390:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d77e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d77ea expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596624.359396:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d77e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d77ea expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596624.359401:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789596624.359422:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d77e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d77ea expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.359428:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596624.359498:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789596624.359505:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+4:5836:x1876527964763264:12345-0@lo:104: Request processed in 639us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596624.359511:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789596624.359539:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964763520 00000100:00100000:2.0:1789596624.359545:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964763520 00000100:00100000:2.0:1789596624.359571:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964763648 00000100:00100000:2.0:1789596624.359574:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964763648 00000100:00100000:2.0:1789596624.359586:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789596624.359668:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596624.359907:0:5824:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1789596624.360103:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa251880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+5:5836:x1876527964763392:12345-0@lo:104: 00010000:00010000:2.0:1789596624.360113:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030800/0x8973ae90b38d77c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d77ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.360163:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789596624.360169:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa251880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+5:5836:x1876527964763392:12345-0@lo:104: Request processed in 71us (1975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596624.360175:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789596624.360192:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789596624.360198:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa250700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+4:5836:x1876527964763520:12345-0@lo:104: 00010000:00010000:2.0:1789596624.360206:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d779d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d77a4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.360232:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789596624.360246:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa250700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+4:5836:x1876527964763520:12345-0@lo:104: Request processed in 47us (1945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596624.360251:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789596624.360264:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789596624.360269:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa250e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:5836:x1876527964763648:12345-0@lo:104: 00010000:00010000:2.0:1789596624.360277:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea902045000/0x8973ae90b38d7773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d777a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.360303:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789596624.360307:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa250e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:5836:x1876527964763648:12345-0@lo:104: Request processed in 39us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596624.360312:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1789596624.360325:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1789596624.360347:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876527964763392:0@lo:104: 00000100:00100000:2.0:1789596624.360354:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876527964763520:0@lo:104: 00000100:00100000:2.0:1789596624.360360:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5836:1876527964763648:0@lo:104: 00010000:00010000:2.0:1789596624.360385:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ea8d5f89c00/0x8973ae90b38d7829 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596624.360415:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964763776 00000100:00100000:2.0:1789596624.360419:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964763776 00010000:00010000:2.0:1789596624.360437:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8c1482400/0x8973ae90b38d7814 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d780d expref: 17 pid: 5834 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596624.360459:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789596624.360465:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:3308:x1876527964763776:12345-0@lo:103: 00010000:00010000:2.0:1789596624.360474:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596624.360479:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8c1482400/0x8973ae90b38d7814 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d780d expref: 17 pid: 5834 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.360495:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8c1482400/0x8973ae90b38d7814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d780d expref: 17 pid: 5834 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.360509:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8c1482400/0x8973ae90b38d7814 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d780d expref: 17 pid: 5834 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.360887:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789596624.360993:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d77e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d77ea expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.361003:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d77e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d77ea expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.361017:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789596624.361020:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d779d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d77a4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.361026:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f9600 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:1.0:1789596624.361029:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d779d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d77a4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.361036:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d779d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d77a4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596624.361042:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d779d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d77a4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596624.361047:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789596624.361080:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d779d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d77a4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.361086:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789596624.361102:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d779d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d77a4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.361118:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9600/0x8973ae90b38d779d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d77a4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.361128:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789596624.361131:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea902045000/0x8973ae90b38d7773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d777a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.361136:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea902045000 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:1.0:1789596624.361139:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea902045000/0x8973ae90b38d7773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d777a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.361147:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea902045000/0x8973ae90b38d7773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d777a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789596624.361152:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea902045000/0x8973ae90b38d7773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d777a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596624.361157:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789596624.361171:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea902045000/0x8973ae90b38d7773 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d777a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.361177:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789596624.361182:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea902045000/0x8973ae90b38d7773 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d777a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.361188:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea902045000/0x8973ae90b38d7773 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d777a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.361198:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596624.361204:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596624.361206:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596624.361221:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964763904:0@lo:103: 00000100:00100000:1.0:1789596624.361256:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596624.361300:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964764032:0@lo:103: 00000100:00100000:1.0:1789596624.361322:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596624.361333:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596624.361338:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964764160:0@lo:103: 00000100:00100000:1.0:1789596624.361354:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596624.361378:0:5828:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789596624.361384:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789596624.362705:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964763904 00000100:00100000:1.0:1789596624.362715:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964763904 00010000:00010000:1.0:1789596624.362742:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea9021f8600/0x8973ae90b38d77ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d77e3 expref: 17 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596624.362764:0:5828:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789596624.362771:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964764032 00000100:00100000:1.0:1789596624.362774:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964764032 00010000:00010000:1.0:1789596624.362785:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea902045a00/0x8973ae90b38d77a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d779d expref: 18 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596624.362807:0:5828:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789596624.362811:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964764160 00000100:00100000:1.0:1789596624.362835:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964764160 00010000:00010000:1.0:1789596624.362847:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d777a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d7773 expref: 19 pid: 5834 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596624.362858:0:5828:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789596624.362865:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789596624.362871:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5780700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3309:x1876527964763904:12345-0@lo:103: 00010000:00010000:1.0:1789596624.362889:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596624.362894:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea9021f8600/0x8973ae90b38d77ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d77e3 expref: 19 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.362905:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea9021f8600/0x8973ae90b38d77ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d77e3 expref: 19 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.362920:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea9021f8600/0x8973ae90b38d77ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d77e3 expref: 19 pid: 5836 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.362932:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596624.362985:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5780700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:3309:x1876527964763904:12345-0@lo:103: Request processed in 114us (1729us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596624.362992:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789596624.363008:0:5828:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789596624.363013:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789596624.363018:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:3306:x1876527964764032:12345-0@lo:103: 00010000:00010000:1.0:1789596624.363025:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596624.363029:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea902045a00/0x8973ae90b38d77a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d779d expref: 17 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.363036:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea902045a00/0x8973ae90b38d77a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d779d expref: 17 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.363046:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea902045a00/0x8973ae90b38d77a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d779d expref: 17 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.363055:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596624.363083:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:3306:x1876527964764032:12345-0@lo:103: Request processed in 64us (1759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596624.363099:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789596624.363111:0:5828:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789596624.363117:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789596624.363123:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5781f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:3306:x1876527964764160:12345-0@lo:103: 00010000:00010000:1.0:1789596624.363130:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596624.363134:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d777a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d7773 expref: 15 pid: 5834 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.363142:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d777a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d7773 expref: 15 pid: 5834 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.363151:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d777a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d7773 expref: 15 pid: 5834 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.363161:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596624.363183:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5781f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:3306:x1876527964764160:12345-0@lo:103: Request processed in 61us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596624.363189:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789596624.363230:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964763904:0@lo:103: 00000100:00100000:1.0:1789596624.363263:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964764160:0@lo:103: 00000100:00100000:1.0:1789596624.363270:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964764032:0@lo:103: 00000100:00100000:2.0:1789596624.363653:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:3308:x1876527964763776:12345-0@lo:103: Request processed in 3185us (4355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596624.363661:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789596624.363972:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596624.363975:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596624.363977:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596624.364036:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964763776:0@lo:103: 00010000:00010000:2.0:1789596624.364078:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030800/0x8973ae90b38d77c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d77ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.364087:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030800 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596624.364092:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030800/0x8973ae90b38d77c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d77ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.364101:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030800/0x8973ae90b38d77c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d77ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596624.364109:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030800/0x8973ae90b38d77c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d77ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596624.364115:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596624.364182:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030800/0x8973ae90b38d77c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d77ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.364189:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789596624.364231:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1789596624.364275:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030800/0x8973ae90b38d77c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d77ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.364291:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030800/0x8973ae90b38d77c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d77ce expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.364308:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596624.364310:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596624.364311:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596624.364361:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964764288:0@lo:103: 00000100:00100000:1.0:1789596624.364399:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596624.364493:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964764288 00000100:00100000:2.0:1789596624.364498:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964764288 00010000:00010000:2.0:1789596624.364517:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d77ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d77c7 expref: 13 pid: 5834 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596624.364708:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789596624.364717:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5781500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:3309:x1876527964764288:12345-0@lo:103: 00010000:00010000:2.0:1789596624.364727:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596624.364732:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d77ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d77c7 expref: 13 pid: 5834 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.364741:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d77ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d77c7 expref: 13 pid: 5834 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.364754:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d77ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d77c7 expref: 13 pid: 5834 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.364769:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ea8d5f89c00/0x8973ae90b38d7829 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.364777:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f89c00/0x8973ae90b38d7829 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.364811:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8d5f89c00/0x8973ae90b38d7829 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.364850:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8d5f89c00/0x8973ae90b38d7829 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.364857:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ea8d5f89c00/0x8973ae90b38d7829 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.364864:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ea8d5f89c00/0x8973ae90b38d7829 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.364870:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89c00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596624.364874:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ea8d5f89c00/0x8973ae90b38d7829 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.364881:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ea8d5f89c00/0x8973ae90b38d7829 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.364897:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ea8d5f89c00/0x8973ae90b38d7829 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.364906:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596624.364940:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5781500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:3309:x1876527964764288:12345-0@lo:103: Request processed in 225us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596624.364947:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789596624.365013:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964764288:0@lo:103: 00010000:00010000:3.0:1789596624.365088:0:5836:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ea8d5f89c00/0x8973ae90b38d7829 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.365106:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f89c00/0x8973ae90b38d7829 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.365112:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f89c00/0x8973ae90b38d7829 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789596624.365123:0:5836:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789596624.412388:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:7636:x1876527964763008:12345-0@lo:253: Request processed in 74219us (75345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596624.412403:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789596624.412465:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964763008:0@lo:253: 10000000:01000000:2.0:1789596624.412496:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789596624.412499:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789596624.412501:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789596624.412502:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596624.412504:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789596624.412505:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596624.412506:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596624.412508:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789596624.412509:0:7636:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789596624.412511:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596624.412512:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789596624.412955:0:7636:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ea8f66d1800 from lustre-OST0001 10000000:01000000:2.0:1789596624.412980:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789596624.412983:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789596624.412990:0:7636:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ea8c2ca3380 local copy 10000000:01000000:2.0:1789596624.412995:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789596624.413029:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d7830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.413041:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d7830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.413051:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d7830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596624.413070:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964764416:0@lo:101: 00000100:00100000:2.0:1789596624.413107:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596624.413173:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c5742840 going to sleep for 11 seconds 00000100:00100000:3.0:1789596624.415098:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964764416 00000100:00100000:3.0:1789596624.415110:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964764416 00000100:00100000:3.0:1789596624.415198:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789596624.415209:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+11:7636:x1876527964764416:12345-0@lo:101: 00010000:00010000:3.0:1789596624.415225:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596624.415242:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f89c00/0x8973ae90b38d7837 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d7830 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.415267:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f89c00/0x8973ae90b38d7837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d7830 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.415278:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f89c00/0x8973ae90b38d7837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7830 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.415286:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89c00, rc 0) 00000100:00100000:3.0:1789596624.415357:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:7636:x1876527964764416:12345-0@lo:101: Request processed in 150us (2249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596624.415364:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789596624.415450:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964764416:0@lo:101: 00010000:00010000:2.0:1789596624.415469:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d7830 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8973ae90b38d7837 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.415495:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d7830 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8973ae90b38d7837 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596624.415619:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964764544:0@lo:501: 00000100:00100000:2.0:1789596624.415652:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596624.416078:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c5742840 going to sleep for 11 seconds 00000100:00100000:0.0:1789596624.416161:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964764544 00000100:00100000:0.0:1789596624.416167:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964764544 00000100:00100000:0.0:1789596624.416193:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789596624.416200:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:7636:x1876527964764544:12345-0@lo:501: 00000100:00100000:0.0:1789596624.416403:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:7636:x1876527964764544:12345-0@lo:501: Request processed in 202us (750us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789596624.416411:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789596624.416491:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964764544:0@lo:501: 10000000:01000000:2.0:1789596624.416505:0:7636:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789596624.416544:0:7636:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789596624.416550:0:7636:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d7830 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8973ae90b38d7837 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.416559:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d7830 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8973ae90b38d7837 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.416566:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d7830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8973ae90b38d7837 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.416592:0:7636:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789596624.416616:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ea8f66d1800 10000000:01000000:2.0:1789596624.416621:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789596624.416626:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789596624.416629:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789596624.416634:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789596624.416637:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789596624.416657:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d783e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.416675:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d783e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.416684:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d783e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596624.416709:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964764672:0@lo:101: 00000100:00100000:2.0:1789596624.416737:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596624.416895:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c5742b40 going to sleep for 11 seconds 00010000:00010000:0.0:1789596624.416952:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596624.416958:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d7830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8973ae90b38d7837 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.416965:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1482400 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:0.0:1789596624.416970:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d7830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8973ae90b38d7837 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.416979:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d7830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x8973ae90b38d7837 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596624.416995:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d7830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x8973ae90b38d7837 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596624.417000:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789596624.417017:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d7830 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8973ae90b38d7837 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.417023:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789596624.417051:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d7830 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8973ae90b38d7837 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.417058:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d7830 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8973ae90b38d7837 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.417071:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596624.417073:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596624.417074:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596624.417084:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964764672 00000100:00100000:0.0:1789596624.417087:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964764672 00000100:00100000:0.0:1789596624.417108:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789596624.417114:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:7636:x1876527964764672:12345-0@lo:101: 00010000:00010000:0.0:1789596624.417121:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596624.417132:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8c0031600/0x8973ae90b38d7845 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d783e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.417151:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c0031600/0x8973ae90b38d7845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d783e expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.417160:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8c0031600/0x8973ae90b38d7845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d783e expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.417175:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0031600, rc 0) 00000100:00100000:0.0:1789596624.417205:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:7636:x1876527964764672:12345-0@lo:101: Request processed in 91us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596624.417211:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789596624.417234:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596624.417247:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964764800:0@lo:103: 00000100:00100000:0.0:1789596624.417273:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596624.417420:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964764800 00000100:00100000:2.0:1789596624.417425:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964764800 00000100:00100000:2.0:1789596624.417464:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789596624.417471:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:3308:x1876527964764800:12345-0@lo:103: 00010000:00010000:2.0:1789596624.417480:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596624.417491:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f89c00/0x8973ae90b38d7837 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8973ae90b38d7830 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.417501:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596624.417531:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:3308:x1876527964764800:12345-0@lo:103: Request processed in 60us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596624.417537:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789596624.417563:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964764800:0@lo:103: 00000100:00100000:2.0:1789596624.417585:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964764672:0@lo:101: 00010000:00010000:2.0:1789596624.417596:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d783e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7845 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.417605:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d783e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7845 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596624.417678:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964764928:0@lo:501: 00000100:00100000:2.0:1789596624.417715:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596624.417726:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c5742b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596624.417963:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964764928 00000100:00100000:0.0:1789596624.417968:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964764928 00000100:00100000:0.0:1789596624.417986:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789596624.417991:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:7636:x1876527964764928:12345-0@lo:501: 00000100:00100000:0.0:1789596624.418162:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:7636:x1876527964764928:12345-0@lo:501: Request processed in 170us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596624.418168:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789596624.418232:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964764928:0@lo:501: 00000100:00100000:2.0:1789596624.418259:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964765056:0@lo:503: 00000100:00100000:2.0:1789596624.418296:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596624.418316:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c5742b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596624.418355:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964765056 00000100:00100000:0.0:1789596624.418359:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964765056 00000100:00100000:0.0:1789596624.418375:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789596624.418381:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:7636:x1876527964765056:12345-0@lo:503: 00000100:00100000:0.0:1789596624.418708:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:7636:x1876527964765056:12345-0@lo:503: Request processed in 326us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596624.418714:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789596624.419070:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964765056:0@lo:503: 00000040:00080000:2.0:1789596624.419354:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789596624.419422:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964765184:0@lo:502: 00000100:00100000:2.0:1789596624.419464:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596624.419576:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c5742b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789596624.419639:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964765184 00000100:00100000:1.0:1789596624.419646:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964765184 00000100:00100000:0.0:1789596624.419703:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789596624.419713:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:7636:x1876527964765184:12345-0@lo:502: 00000100:00100000:0.0:1789596624.420356:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:7636:x1876527964765184:12345-0@lo:502: Request processed in 643us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596624.420372:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789596624.420458:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964765184:0@lo:502: 00000040:00080000:2.0:1789596624.420762:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789596624.420856:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789596624.420897:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789596624.420961:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789596624.421001:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789596624.421036:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789596624.421068:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964765312:0@lo:502: 00000100:00100000:2.0:1789596624.421112:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596624.421136:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c5742b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596624.421445:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964765312 00000100:00100000:3.0:1789596624.421451:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964765312 00000100:00100000:3.0:1789596624.421496:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789596624.421504:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:7636:x1876527964765312:12345-0@lo:502: 00000100:00100000:3.0:1789596624.421701:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:7636:x1876527964765312:12345-0@lo:502: Request processed in 197us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596624.421708:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789596624.421997:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964765312:0@lo:502: 00000040:00080000:2.0:1789596624.422097:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789596624.422116:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1789596624.422600:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789596624.422608:0:7646:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789596624.422614:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596624.422616:0:7646:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789596624.422620:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789596624.422634:0:7646:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ea9007b4d40) 00000020:00000080:2.0:1789596624.422656:0:7646:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789596624.422661:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789596624.422982:0:7646:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ea8f66d1800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789596624.422989:0:7646:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789596624.422996:0:7646:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8973ae90b38d7853 00010000:00010000:2.0:1789596624.427093:0:7646:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1789596624.427371:0:7646:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789596624.431239:0:7646:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789596624.431601:0:7646:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789596624.442615:0:7646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789596624.443217:0:7646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789596624.445224:0:7646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789596624.445233:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596624.445238:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596624.445239:0:7646:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789596624.445242:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596624.445245:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596624.445246:0:7646:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789596624.445247:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789596624.445249:0:7646:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789596624.445289:0:7646:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596624.445291:0:7646:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596624.445292:0:7646:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789596624.445294:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789596624.445408:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789596624.445429:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789596624.445447:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d783e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7845 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.445456:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d783e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7845 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596624.445462:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea8f66d1800 from 1 10000000:01000000:2.0:1789596624.445464:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789596624.445494:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482600/0x8973ae90b38d785a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.445500:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482600/0x8973ae90b38d785a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.445701:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482600/0x8973ae90b38d785a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596624.445729:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964765440:0@lo:101: 00000100:00100000:2.0:1789596624.448488:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596624.449053:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff58d900 going to sleep for 11 seconds 00000100:00100000:0.0:1789596624.449131:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964765440 00000100:00100000:0.0:1789596624.449139:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964765440 00000100:00100000:0.0:1789596624.449228:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789596624.449238:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:7636:x1876527964765440:12345-0@lo:101: 00010000:00010000:0.0:1789596624.449253:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596624.449271:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7861 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d785a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.449298:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7861 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d785a expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.449310:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7861 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d785a expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.449319:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0031000, rc 0) 00000100:00100000:0.0:1789596624.449386:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:7636:x1876527964765440:12345-0@lo:101: Request processed in 150us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596624.449393:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789596624.449467:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964765440:0@lo:101: 00010000:00010000:2.0:1789596624.449483:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482600/0x8973ae90b38d785a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7861 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.449492:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482600/0x8973ae90b38d785a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7861 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596624.449734:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964765568:0@lo:501: 00000100:00100000:2.0:1789596624.449772:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596624.450082:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964765568 00000100:00100000:3.0:1789596624.450088:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964765568 00000100:00100000:3.0:1789596624.450112:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789596624.450119:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:7636:x1876527964765568:12345-0@lo:501: 00000100:00100000:3.0:1789596624.450338:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:7636:x1876527964765568:12345-0@lo:501: Request processed in 219us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596624.450346:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789596624.450451:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff58d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789596624.450466:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964765568:0@lo:501: 00000100:00100000:2.0:1789596624.450498:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964765696:0@lo:503: 00000100:00100000:2.0:1789596624.450926:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596624.450985:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff58d900 going to sleep for 11 seconds 00000100:00100000:3.0:1789596624.451018:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964765696 00000100:00100000:3.0:1789596624.451023:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964765696 00000100:00100000:3.0:1789596624.451081:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789596624.451089:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:7636:x1876527964765696:12345-0@lo:503: 00000100:00100000:3.0:1789596624.451403:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:7636:x1876527964765696:12345-0@lo:503: Request processed in 315us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596624.451410:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789596624.454193:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964765696:0@lo:503: 00000040:00080000:2.0:1789596624.456310:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789596624.456420:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964765824:0@lo:502: 00000100:00100000:2.0:1789596624.456493:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596624.456600:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff58d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789596624.457842:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964765824 00000100:00100000:1.0:1789596624.457854:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964765824 00000100:00100000:1.0:1789596624.457904:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789596624.457912:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:7636:x1876527964765824:12345-0@lo:502: 00000100:00100000:1.0:1789596624.458161:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:7636:x1876527964765824:12345-0@lo:502: Request processed in 248us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596624.458169:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789596624.458197:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964765824:0@lo:502: 00000040:00080000:2.0:1789596624.458492:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789596624.458699:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789596624.458732:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964765952:0@lo:502: 00000100:00100000:2.0:1789596624.458784:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596624.458858:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff58d900 going to sleep for 11 seconds 00000100:00100000:3.0:1789596624.459052:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964765952 00000100:00100000:3.0:1789596624.459057:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964765952 00000100:00100000:3.0:1789596624.459090:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789596624.459098:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:7636:x1876527964765952:12345-0@lo:502: 00000100:00100000:3.0:1789596624.459227:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:7636:x1876527964765952:12345-0@lo:502: Request processed in 130us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596624.459235:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789596624.459322:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964765952:0@lo:502: 00000040:00080000:2.0:1789596624.459402:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789596624.459411:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789596624.460472:0:7650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596624.460482:0:7650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596624.460485:0:7650:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789596624.460491:0:7650:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ea8f66d1800 00000020:00000080:2.0:1789596624.460494:0:7650:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789596624.460511:0:7650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596624.460515:0:7650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596624.460516:0:7650:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789596624.460587:0:7650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789596624.461187:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789596624.461217:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789596624.461352:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482600/0x8973ae90b38d785a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7861 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.461366:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482600/0x8973ae90b38d785a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7861 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596624.461415:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789596624.461418:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ea8f66d1800 10000000:01000000:3.0:1789596624.461421:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ea8f66d1800 10000000:01000000:3.0:1789596624.461425:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789596624.461430:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ea8f66d1800 from 1 10000000:01000000:3.0:1789596624.461433:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789596624.461467:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89600/0x8973ae90b38d7868 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.461476:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89600/0x8973ae90b38d7868 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596624.461502:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89600/0x8973ae90b38d7868 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596624.461534:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964766080:0@lo:101: 00000100:00100000:3.0:1789596624.461601:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596624.461646:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c56d3600 going to sleep for 11 seconds 00000100:00100000:1.0:1789596624.461713:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964766080 00000100:00100000:1.0:1789596624.461721:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964766080 00000100:00100000:1.0:1789596624.461774:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789596624.461784:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:7636:x1876527964766080:12345-0@lo:101: 00010000:00010000:1.0:1789596624.461806:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596624.461848:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d786f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d7868 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.461871:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d786f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d7868 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.461882:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d786f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7868 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.461891:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea9021f9e00, rc 0) 00000100:00100000:1.0:1789596624.461936:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:7636:x1876527964766080:12345-0@lo:101: Request processed in 154us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596624.461944:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789596624.462174:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964766080:0@lo:101: 00010000:00010000:2.0:1789596624.462188:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89600/0x8973ae90b38d7868 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d786f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.462197:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89600/0x8973ae90b38d7868 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d786f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596624.462291:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964766208:0@lo:501: 00000100:00100000:2.0:1789596624.462318:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596624.462342:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff58d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789596624.462637:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964766208 00000100:00100000:0.0:1789596624.462642:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964766208 00000100:00100000:0.0:1789596624.462763:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789596624.462772:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:7636:x1876527964766208:12345-0@lo:501: 00000100:00100000:0.0:1789596624.463042:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:7636:x1876527964766208:12345-0@lo:501: Request processed in 271us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596624.463050:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789596624.463124:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964766208:0@lo:501: 00000100:00100000:2.0:1789596624.463159:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964766336:0@lo:503: 00000100:00100000:2.0:1789596624.463196:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596624.464234:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff58d780 going to sleep for 11 seconds 00000100:00100000:1.0:1789596624.464338:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964766336 00000100:00100000:1.0:1789596624.464357:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964766336 00000100:00100000:1.0:1789596624.464391:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789596624.464399:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:7636:x1876527964766336:12345-0@lo:503: 00000100:00100000:1.0:1789596624.464596:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:7636:x1876527964766336:12345-0@lo:503: Request processed in 197us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596624.464604:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789596624.464799:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964766336:0@lo:503: 00000040:00080000:2.0:1789596624.465077:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789596624.465137:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964766464:0@lo:502: 00000100:00100000:2.0:1789596624.465177:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596624.465197:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff58d780 going to sleep for 11 seconds 00000100:00100000:1.0:1789596624.465322:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964766464 00000100:00100000:1.0:1789596624.465327:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964766464 00000100:00100000:1.0:1789596624.465347:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789596624.465353:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:7636:x1876527964766464:12345-0@lo:502: 00000100:00100000:1.0:1789596624.465504:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:7636:x1876527964766464:12345-0@lo:502: Request processed in 150us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596624.465512:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789596624.465641:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964766464:0@lo:502: 00000040:00080000:2.0:1789596624.466053:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789596624.466104:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789596624.466141:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789596624.466190:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789596624.466233:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789596624.466283:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789596624.466320:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789596624.466357:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789596624.466405:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789596624.466443:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789596624.466488:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789596624.467014:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789596624.467056:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789596624.467087:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789596624.467145:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789596624.467182:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789596624.467212:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789596624.467257:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789596624.467292:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789596624.467323:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789596624.467390:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789596624.467427:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789596624.467457:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789596624.467502:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789596624.467550:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789596624.467585:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789596624.467660:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789596624.467713:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1789596624.468614:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789596624.468731:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1789596624.469245:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1789596624.469287:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1789596624.469337:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1789596624.469399:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1789596624.469438:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1789596624.469509:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1789596624.469562:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1789596624.469617:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa251500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964766592:0@lo:502: 00000100:00100000:0.0:1789596624.470038:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596624.470090:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c3156d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789596624.470146:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964766592 00000100:00100000:2.0:1789596624.470154:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964766592 00000100:00100000:2.0:1789596624.470205:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789596624.470214:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:7636:x1876527964766592:12345-0@lo:502: 00000100:00100000:2.0:1789596624.470437:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:7636:x1876527964766592:12345-0@lo:502: Request processed in 223us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596624.470446:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789596624.470540:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa251500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964766592:0@lo:502: 00000040:00080000:3.0:1789596624.470621:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1789596624.470636:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789596624.471348:0:7651:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789596624.471363:0:7651:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ea8f66f4d40) 00000020:00000080:3.0:1789596624.471382:0:7651:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1789596624.471449:0:7651:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ea8f66d1800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789596624.471453:0:7651:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ea8f66d1800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789596624.471456:0:7651:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ea8f66d1800 3 00010000:00080000:3.0:1789596624.471484:0:7651:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ea90077e000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.144@tcp at head 00010000:00010000:3.0:1789596624.474083:0:7651:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1789596624.474325:0:7651:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789596624.474362:0:7651:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789596624.474376:0:7651:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8973ae90b38d787d 00000100:00080000:3.0:1789596624.474386:0:7651:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789596624.474396:0:7651:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ea90077e000 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:3.0:1789596624.474441:0:7651:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ea8c6ec2d80 x1876527964766720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789596624.474476:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876527964766720:0@lo:38: 00000100:00100000:3.0:1789596624.474665:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789596624.474740:0:7651:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789596624.474862:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964766720 00000100:00100000:1.0:1789596624.474870:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964766720 00000100:00100000:1.0:1789596624.474905:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789596624.474912:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876527964766720:12345-0@lo:38: 00010000:00080000:1.0:1789596624.474935:0:5843:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:1.0:1789596624.474974:0:5843:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8973ae90b38d7884 00000004:00100000:1.0:1789596624.474990:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789596624.475022:0:5843:0:(import.c:65:import_set_state_nolock()) ffff9ea8ef42f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789596624.475074:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876527964766720:12345-0@lo:38: Request processed in 161us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596624.475081:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789596624.475124:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8c6ec2d80 x1876527964766720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789596634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596624.475134:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789596624.475147:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789596624.475154:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789596624.475157:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789596624.475160:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea90077e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789596624.475165:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876527964766720:0@lo:38: 00000100:00100000:1.0:1789596624.476023:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964766848:0@lo:400: 00000100:00100000:1.0:1789596624.476067:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596624.476095:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596624.476100:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964766976:0@lo:400: 00000100:00100000:1.0:1789596624.476120:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596624.476156:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964766848 00000100:00100000:1.0:1789596624.476161:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964766848 00000100:00100000:1.0:1789596624.476191:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964766976 00000100:00100000:1.0:1789596624.476194:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964766976 00000100:00100000:1.0:1789596624.476223:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789596624.476229:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964766848:12345-0@lo:400: 00000100:00100000:1.0:1789596624.476268:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964766848:12345-0@lo:400: Request processed in 39us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596624.476275:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789596624.476289:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789596624.476295:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964766976:12345-0@lo:400: 00000100:00100000:1.0:1789596624.476319:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964766976:12345-0@lo:400: Request processed in 25us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596624.476325:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789596624.476341:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789596624.476366:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8fa252300 x1876527964766976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596624.476391:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964766976:0@lo:400: 00010000:00080000:1.0:1789596624.476405:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8fa251c00 x1876527964766848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596624.476412:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964766848:0@lo:400: 00000100:00100000:3.0:1789596624.476890:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964767104:0@lo:400: 00000100:00100000:3.0:1789596624.476927:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596624.477178:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964767104 00000100:00100000:1.0:1789596624.477184:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964767104 00000100:00100000:1.0:1789596624.477222:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789596624.477228:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964767104:12345-0@lo:400: 00000100:00100000:1.0:1789596624.477269:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964767104:12345-0@lo:400: Request processed in 41us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596624.477276:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789596624.477292:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789596624.477314:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8fa252680 x1876527964767104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596624.477324:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964767104:0@lo:400: 00000100:00100000:0.0:1789596624.477646:0:7652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa252d80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7652:1876527964767232:0@lo:901: 00000100:00100000:0.0:1789596624.477870:0:7652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596624.477908:0:7652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c3156240 going to sleep for 11 seconds 00000100:00100000:1.0:1789596624.478001:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964767232 00000100:00100000:1.0:1789596624.478006:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964767232 00000100:00100000:1.0:1789596624.478039:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789596624.478045:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7652:x1876527964767232:12345-0@lo:901: 00000100:00100000:1.0:1789596624.478378:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7652:x1876527964767232:12345-0@lo:901: Request processed in 330us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596624.478386:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1789596624.478497:0:7651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:0.0:1789596624.479360:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789596624.479397:0:7652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8fa252d80 x1876527964767232/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789596640 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596624.479411:0:7652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa252d80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7652:1876527964767232:0@lo:901: 00000020:01000000:0.0:1789596624.479966:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1789596624.479993:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789596624.480007:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89600/0x8973ae90b38d7868 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d786f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.480018:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89600/0x8973ae90b38d7868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d786f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789596624.480067:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789596624.480069:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789596624.480071:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789596624.480072:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789596624.480073:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789596624.480075:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789596624.480076:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789596624.480083:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789596624.480084:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789596624.480085:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789596624.480087:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789596624.480090:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1789596624.480092:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789596624.480093:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789596624.480094:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789596624.480095:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789596624.480096:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789596624.480097:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789596624.480098:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789596624.480099:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789596624.480100:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789596624.480101:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789596624.480102:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789596624.480123:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789596624.480136:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa252d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964767360:0@lo:253: 00000100:00100000:0.0:1789596624.480184:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596624.480219:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c3156240 going to sleep for 11 seconds 00000100:00100000:3.0:1789596624.480672:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964767360 00000100:00100000:3.0:1789596624.480679:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964767360 00000100:00100000:3.0:1789596624.480734:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789596624.480743:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:7636:x1876527964767360:12345-0@lo:253: 20000000:01000000:3.0:1789596624.480965:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789596624.480979:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789596624.524550:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789596624.524569:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789596624.524634:0:5857:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789596624.524639:0:5857:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789596624.524662:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d788b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.524679:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d77dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d77d5 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.524687:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d788b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.524728:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d77dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d77d5 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.524741:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d77dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d77d5 expref: 14 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596624.524796:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa252680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1876527964767488:0@lo:104: 00000100:00100000:0.0:1789596624.524891:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596624.524933:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c3156780 going to sleep for 11 seconds 00000100:00100000:2.0:1789596624.525029:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964767488 00000100:00100000:2.0:1789596624.525039:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964767488 00000100:00100000:2.0:1789596624.525081:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789596624.525090:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:5857:x1876527964767488:12345-0@lo:104: 00010000:00010000:2.0:1789596624.525102:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030a00/0x8973ae90b38d77d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d77dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.525166:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789596624.525172:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:5857:x1876527964767488:12345-0@lo:104: Request processed in 84us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596624.525179:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789596624.525212:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596624.525218:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030a00/0x8973ae90b38d77d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d77dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.525232:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030a00 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596624.525236:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030a00/0x8973ae90b38d77d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d77dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.525245:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030a00/0x8973ae90b38d77d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d77dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596624.525253:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030a00/0x8973ae90b38d77d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d77dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596624.525259:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596624.525288:0:7643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030a00/0x8973ae90b38d77d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d77dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.525295:0:7643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596624.525315:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030a00/0x8973ae90b38d77d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d77dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.525321:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030a00/0x8973ae90b38d77d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d77dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596624.525338:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596624.525340:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596624.525342:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596624.525360:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964767616:0@lo:103: 00000100:00100000:2.0:1789596624.525391:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596624.525619:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa252680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5857:1876527964767488:0@lo:104: 00010000:00010000:1.0:1789596624.525645:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d788b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596624.525715:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964767616 00000100:00100000:0.0:1789596624.525720:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964767616 00010000:00010000:0.0:1789596624.525740:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d77dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d77d5 expref: 15 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596624.525779:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789596624.525797:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c8281850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:3309:x1876527964767616:12345-0@lo:103: 00010000:00010000:0.0:1789596624.525808:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596624.525813:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d77dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d77d5 expref: 15 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.525844:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d77dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d77d5 expref: 15 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.525858:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d77dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d77d5 expref: 15 pid: 5835 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.525871:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d788b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.525879:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d788b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789596624.525892:0:7644:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001958606s 00010000:00010000:0.0:1789596624.525897:0:7644:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d788b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.525915:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d788b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.525922:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d788b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.525928:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d788b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.525933:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596624.525937:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d788b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.525944:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d788b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.525968:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d788b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596624.525977:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596624.526014:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c8281850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:3309:x1876527964767616:12345-0@lo:103: Request processed in 228us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596624.526021:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789596624.526087:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964767616:0@lo:103: 00010000:00010000:1.0:1789596624.526145:0:5857:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d788b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.526153:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d788b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596624.526159:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d788b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596624.536084:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:7636:x1876527964767360:12345-0@lo:253: Request processed in 55333us (55890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596624.536100:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789596624.536202:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa252d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7810da1-eaae-414b-ba87-f9d6f005a55b:7636:1876527964767360:0@lo:253: 10000000:01000000:2.0:1789596624.536218:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789596624.536237:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789596624.536239:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789596624.536241:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596624.536243:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789596624.536244:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596624.536245:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596624.536247:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789596624.536249:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789596624.536250:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789596624.536251:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596624.536253:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789596624.536268:0:7636:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789596624.542482:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789596624.542959:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789596624.543181:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789596624.543480:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789596624.544299:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789596624.545976:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789596624.549237:0:7636:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1789596624.671630:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789596624.803498:0:7636:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789596624.803507:0:7636:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789596624.803541:0:7636:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789596624.803679:0:7636:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.144@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789596624.803774:0:7636:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789596624.803812:0:7636:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789596625.692002:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596626.714973:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596627.739011:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596628.002449:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789596628.002477:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964767744:0@lo:13: 00000100:00100000:3.0:1789596628.002552:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596628.002613:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964767744 00000100:00100000:3.0:1789596628.002621:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964767744 00000100:00100000:3.0:1789596628.002673:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789596628.002682:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964767744:12345-0@lo:13: 00002000:00000024:3.0:1789596628.002726:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596628.002779:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964767744:12345-0@lo:13: Request processed in 97us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596628.002787:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789596628.002852:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c6ec2300 x1876527964767744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596628.002871:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964767744:0@lo:13: 00000100:00080000:0.0:1789596628.003055:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789596628.764102:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596629.539477:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964767872:0@lo:400: 00000100:00100000:2.0:1789596629.539547:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596629.539594:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876527964768384:0@lo:400: 00000100:00100000:2.0:1789596629.539624:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596629.539653:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789596629.539806:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964768256:0@lo:400: 00000100:00100000:2.0:1789596629.539859:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596629.539888:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964768000:0@lo:400: 00000100:00100000:2.0:1789596629.539912:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596629.539930:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596629.539935:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964768128:0@lo:400: 00000100:00100000:2.0:1789596629.539955:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596629.539987:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964767872 00000100:00100000:2.0:1789596629.539994:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964767872 00000100:00100000:2.0:1789596629.540049:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789596629.540058:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:3307:x1876527964767872:12345-0@lo:400: 00000100:00100000:2.0:1789596629.540131:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:3307:x1876527964767872:12345-0@lo:400: Request processed in 74us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596629.540138:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789596629.540851:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964768384 00000100:00100000:2.0:1789596629.540858:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964768384 00000100:00100000:2.0:1789596629.540896:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964768000 00000100:00100000:2.0:1789596629.540899:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964768000 00000100:00100000:2.0:1789596629.540910:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964768128 00000100:00100000:2.0:1789596629.540912:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964768128 00000100:00100000:2.0:1789596629.540926:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789596629.540932:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876527964768384:12345-0@lo:400: 00000100:00100000:2.0:1789596629.540976:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876527964768384:12345-0@lo:400: Request processed in 45us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596629.540982:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789596629.540994:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789596629.541000:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964768000:12345-0@lo:400: 00000100:00100000:2.0:1789596629.541030:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964768000:12345-0@lo:400: Request processed in 31us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596629.541035:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789596629.541046:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789596629.541052:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964768128:12345-0@lo:400: 00000100:00100000:2.0:1789596629.541078:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964768128:12345-0@lo:400: Request processed in 27us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596629.541083:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789596629.541101:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964768256 00000100:00100000:2.0:1789596629.541105:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964768256 00000100:00100000:2.0:1789596629.541132:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789596629.541150:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964768256:12345-0@lo:400: 00000100:00100000:2.0:1789596629.542873:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964768256:12345-0@lo:400: Request processed in 1722us (3011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596629.542883:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789596629.542921:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789596629.542961:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea90000ad80 x1876527964768128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596629.542977:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964768128:0@lo:400: 00010000:00080000:2.0:1789596629.542991:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea900009180 x1876527964768000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596629.542999:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964768000:0@lo:400: 00010000:00080000:2.0:1789596629.543036:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea90000bb80 x1876527964768256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596629.543045:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964768256:0@lo:400: 00000100:00100000:2.0:1789596629.543056:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964767872:0@lo:400: 00010000:00080000:2.0:1789596629.543066:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea90000a680 x1876527964768384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596629.543074:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876527964768384:0@lo:400: 00010000:00010000:1.0:1789596629.789360:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596630.811908:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789596630.942222:0:7995:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg244-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789596631.835150:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596632.866854:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596633.117296:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964768512:0@lo:13: 00000100:00100000:2.0:1789596633.117372:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596633.117665:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964768512 00000100:00100000:3.0:1789596633.117683:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964768512 00000100:00100000:3.0:1789596633.117756:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789596633.117766:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964768512:12345-0@lo:13: 00002000:00000024:3.0:1789596633.117799:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789596633.117912:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596633.118383:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964768512:12345-0@lo:13: Request processed in 617us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596633.118392:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789596633.118936:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c5781c00 x1876527964768512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596633.118970:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964768512:0@lo:13: 10000000:01000000:2.0:1789596633.626948:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789596633.626956:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ea8f9e94000 from 30 10000000:01000000:2.0:1789596633.626961:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789596633.627011:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483c00/0x8973ae90b38d7892 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596633.627024:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483c00/0x8973ae90b38d7892 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596633.627036:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483c00/0x8973ae90b38d7892 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596633.627060:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964768640:0@lo:101: 00000100:00100000:2.0:1789596633.627130:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596633.627203:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b000 going to sleep for 11 seconds 00000100:00100000:0.0:1789596633.627290:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964768640 00000100:00100000:0.0:1789596633.627298:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964768640 00000100:00100000:0.0:1789596633.627352:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789596633.627362:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:5838:x1876527964768640:12345-0@lo:101: 00010000:00010000:0.0:1789596633.627375:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596633.627389:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8c0030a00/0x8973ae90b38d7899 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d7892 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596633.627412:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c0030a00/0x8973ae90b38d7899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d7892 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596633.627423:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8c0030a00/0x8973ae90b38d7899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7892 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596633.627431:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030a00, rc 0) 00000100:00100000:0.0:1789596633.627497:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:5838:x1876527964768640:12345-0@lo:101: Request processed in 137us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596633.627561:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964768640:0@lo:101: 00010000:00010000:2.0:1789596633.627575:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483c00/0x8973ae90b38d7892 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7899 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596633.627584:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483c00/0x8973ae90b38d7892 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7899 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596633.627635:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964768768:0@lo:501: 00000100:00100000:2.0:1789596633.627662:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596633.627690:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b000 going to sleep for 11 seconds 00000100:00100000:3.0:1789596633.627764:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964768768 00000100:00100000:3.0:1789596633.627769:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964768768 00000100:00100000:0.0:1789596633.633095:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789596633.634169:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789596633.634189:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:5838:x1876527964768768:12345-0@lo:501: 00000100:00100000:3.0:1789596633.634614:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:5838:x1876527964768768:12345-0@lo:501: Request processed in 434us (6950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596633.634623:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789596633.634725:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964768768:0@lo:501: 00000100:00100000:2.0:1789596633.634789:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964768896:0@lo:503: 00000100:00100000:2.0:1789596633.634850:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596633.650827:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b000 going to sleep for 11 seconds 00000100:00100000:1.0:1789596633.651199:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964768896 00000100:00100000:1.0:1789596633.651209:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964768896 00000100:00100000:1.0:1789596633.651260:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789596633.651268:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:5838:x1876527964768896:12345-0@lo:503: 00000100:00100000:1.0:1789596633.651666:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:5838:x1876527964768896:12345-0@lo:503: Request processed in 397us (16815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596633.651674:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789596633.652016:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964768896:0@lo:503: 00000100:00100000:2.0:1789596633.652523:0:8100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8100:1876527964769024:0@lo:502: 00000100:00100000:2.0:1789596633.652578:0:8100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596633.652652:0:8100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596633.655291:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964769024 00000100:00100000:1.0:1789596633.655309:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964769024 00000100:00100000:1.0:1789596633.655374:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789596633.655384:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:8100:x1876527964769024:12345-0@lo:502: 00000100:00100000:1.0:1789596633.656179:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:8100:x1876527964769024:12345-0@lo:502: Request processed in 794us (3598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596633.656188:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789596633.656323:0:8100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8100:1876527964769024:0@lo:502: 00000100:00100000:2.0:1789596633.656391:0:8100:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8100:1876527964769152:0@lo:502: 00000100:00100000:2.0:1789596633.656435:0:8100:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596633.656482:0:8100:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789596633.656676:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964769152 00000100:00100000:3.0:1789596633.656682:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964769152 00000100:00100000:3.0:1789596633.656720:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789596633.656799:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:8100:x1876527964769152:12345-0@lo:502: 00000100:00100000:3.0:1789596633.657062:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:8100:x1876527964769152:12345-0@lo:502: Request processed in 334us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596633.657069:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789596633.657201:0:8100:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8100:1876527964769152:0@lo:502: 00000040:00080000:2.0:1789596633.657222:0:8100:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789596633.666176:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789596633.666215:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789596633.666228:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483c00/0x8973ae90b38d7892 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7899 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596633.666241:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483c00/0x8973ae90b38d7892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7899 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596633.666253:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789596633.666256:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789596633.666258:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789596633.666314:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9200/0x8973ae90b38d78a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596633.666323:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9200/0x8973ae90b38d78a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596633.666333:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9200/0x8973ae90b38d78a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596633.666357:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5781880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964769280:0@lo:101: 00000100:00100000:1.0:1789596633.666428:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596633.666483:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c3157840 going to sleep for 11 seconds 00000100:00100000:3.0:1789596633.667216:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964769280 00000100:00100000:3.0:1789596633.667227:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964769280 00000100:00100000:3.0:1789596633.667308:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789596633.667318:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:5838:x1876527964769280:12345-0@lo:101: 00010000:00010000:3.0:1789596633.667333:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596633.667349:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d78a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d78a0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596633.667373:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d78a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d78a0 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596633.667383:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d78a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d78a0 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596633.667391:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88400, rc 0) 00000100:00100000:3.0:1789596633.667449:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:5838:x1876527964769280:12345-0@lo:101: Request processed in 132us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596633.667454:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789596633.667740:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5781880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964769280:0@lo:101: 00010000:00010000:2.0:1789596633.667758:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9200/0x8973ae90b38d78a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d78a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596633.667767:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9200/0x8973ae90b38d78a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d78a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596633.667862:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964769408:0@lo:501: 00000100:00100000:2.0:1789596633.667894:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596633.667916:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789596633.668099:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964769408 00000100:00100000:0.0:1789596633.668104:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964769408 00000100:00100000:0.0:1789596633.668138:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789596633.668146:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:5838:x1876527964769408:12345-0@lo:501: 00000100:00100000:0.0:1789596633.668419:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:5838:x1876527964769408:12345-0@lo:501: Request processed in 273us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596633.668425:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789596633.669635:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964769408:0@lo:501: 00000100:00100000:2.0:1789596633.669713:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964769536:0@lo:503: 00000100:00100000:2.0:1789596633.669783:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596633.669844:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596633.669974:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964769536 00000100:00100000:1.0:1789596633.669981:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964769536 00000100:00100000:1.0:1789596633.670032:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789596633.670040:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:5838:x1876527964769536:12345-0@lo:503: 00000100:00100000:1.0:1789596633.670389:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:5838:x1876527964769536:12345-0@lo:503: Request processed in 348us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596633.670396:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789596633.670955:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964769536:0@lo:503: 00000100:00100000:3.0:1789596633.676669:0:8101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8101:1876527964769664:0@lo:502: 00000100:00100000:3.0:1789596633.676779:0:8101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596633.676855:0:8101:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c86d9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789596633.677089:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964769664 00000100:00100000:1.0:1789596633.677098:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964769664 00000100:00100000:1.0:1789596633.677150:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789596633.677160:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:8101:x1876527964769664:12345-0@lo:502: 00000100:00100000:1.0:1789596633.677455:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:8101:x1876527964769664:12345-0@lo:502: Request processed in 296us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596633.677463:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789596633.678266:0:8101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8101:1876527964769664:0@lo:502: 00000020:01000000:3.0:1789596633.678314:0:8101:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596633.678324:0:8101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596633.678326:0:8101:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789596633.678331:0:8101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789596633.678333:0:8101:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789596633.678358:0:8101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8101:1876527964769792:0@lo:502: 00000100:00100000:3.0:1789596633.678404:0:8101:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596633.678442:0:8101:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c86d9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596633.678592:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964769792 00000100:00100000:2.0:1789596633.678599:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964769792 00000100:00100000:2.0:1789596633.678640:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789596633.678647:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:8101:x1876527964769792:12345-0@lo:502: 00000100:00100000:2.0:1789596633.678862:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:8101:x1876527964769792:12345-0@lo:502: Request processed in 214us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596633.678869:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789596633.679321:0:8101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8101:1876527964769792:0@lo:502: 00000020:01000000:0.0:1789596633.679345:0:8101:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596633.679358:0:8101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596633.679360:0:8101:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789596633.679365:0:8101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1789596633.680095:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1789596633.680116:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789596633.680126:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9200/0x8973ae90b38d78a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d78a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596633.680137:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9200/0x8973ae90b38d78a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d78a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596633.680147:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789596633.680149:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ea8e4942800 from 30 10000000:01000000:2.0:1789596633.680152:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789596633.680184:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d78ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596633.680193:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d78ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596633.680215:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d78ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596633.680231:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964769920:0@lo:101: 00000100:00100000:2.0:1789596633.680289:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596633.680316:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b780 going to sleep for 11 seconds 00000100:00100000:0.0:1789596633.680453:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964769920 00000100:00100000:0.0:1789596633.680459:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964769920 00000100:00100000:0.0:1789596633.680515:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789596633.680524:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:5838:x1876527964769920:12345-0@lo:101: 00010000:00010000:0.0:1789596633.680535:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596633.680546:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d78b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d78ae expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596633.680567:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d78b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d78ae expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596633.680576:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d78b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d78ae expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596633.680584:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030800, rc 0) 00000100:00100000:0.0:1789596633.680619:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:5838:x1876527964769920:12345-0@lo:101: Request processed in 96us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596633.680624:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789596633.683207:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964769920:0@lo:101: 00010000:00010000:2.0:1789596633.683236:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d78ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d78b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596633.683250:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d78ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d78b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596633.683338:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964770048:0@lo:501: 00000100:00100000:2.0:1789596633.683398:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596633.683437:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b780 going to sleep for 11 seconds 00000100:00100000:0.0:1789596633.683734:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964770048 00000100:00100000:0.0:1789596633.683742:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964770048 00000100:00100000:0.0:1789596633.683795:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789596633.683804:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:5838:x1876527964770048:12345-0@lo:501: 00000100:00100000:0.0:1789596633.684199:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:5838:x1876527964770048:12345-0@lo:501: Request processed in 395us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596633.684208:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789596633.684609:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964770048:0@lo:501: 00000100:00100000:2.0:1789596633.684644:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964770176:0@lo:503: 00000100:00100000:2.0:1789596633.684687:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596633.684717:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b780 going to sleep for 11 seconds 00000100:00100000:1.0:1789596633.684806:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964770176 00000100:00100000:1.0:1789596633.684811:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964770176 00000100:00100000:1.0:1789596633.684864:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789596633.684871:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:5838:x1876527964770176:12345-0@lo:503: 00000100:00100000:1.0:1789596633.685084:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:5838:x1876527964770176:12345-0@lo:503: Request processed in 212us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596633.685091:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789596633.685181:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964770176:0@lo:503: 00000100:00100000:2.0:1789596633.686123:0:8102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8102:1876527964770304:0@lo:502: 00000100:00100000:2.0:1789596633.686167:0:8102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596633.686243:0:8102:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b000 going to sleep for 11 seconds 00000100:00100000:3.0:1789596633.688760:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964770304 00000100:00100000:3.0:1789596633.688793:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964770304 00000100:00100000:3.0:1789596633.689114:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789596633.689124:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:8102:x1876527964770304:12345-0@lo:502: 00000100:00100000:3.0:1789596633.689656:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:8102:x1876527964770304:12345-0@lo:502: Request processed in 534us (3487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596633.689664:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789596633.689860:0:8102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8102:1876527964770304:0@lo:502: 00000100:00100000:2.0:1789596633.689939:0:8102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8102:1876527964770432:0@lo:502: 00000100:00100000:0.0:1789596633.690183:0:8102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596633.690226:0:8102:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789596633.690286:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964770432 00000100:00100000:2.0:1789596633.690291:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964770432 00000100:00100000:2.0:1789596633.690328:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789596633.690335:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:8102:x1876527964770432:12345-0@lo:502: 00000100:00100000:2.0:1789596633.690719:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:8102:x1876527964770432:12345-0@lo:502: Request processed in 385us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596633.690834:0:8102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8102:1876527964770432:0@lo:502: 00000040:00080000:0.0:1789596633.690857:0:8102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789596633.691063:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789596633.691082:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789596633.691092:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d78ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d78b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596633.691106:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d78ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d78b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596633.691115:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789596633.691125:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ea8e4942800 from 5 10000000:01000000:1.0:1789596633.691128:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789596633.691155:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8600/0x8973ae90b38d78bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596633.691164:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8600/0x8973ae90b38d78bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596633.691172:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8600/0x8973ae90b38d78bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596633.691185:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5780e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964770560:0@lo:101: 00000100:00100000:1.0:1789596633.691219:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596633.691250:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c3157b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596633.691397:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789596633.691429:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964770560 00000100:00100000:2.0:1789596633.691433:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964770560 00000100:00100000:2.0:1789596633.691614:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789596633.691624:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:5838:x1876527964770560:12345-0@lo:101: 00010000:00010000:2.0:1789596633.691634:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596633.691646:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8c1482c00/0x8973ae90b38d78c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d78bc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596633.691667:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c1482c00/0x8973ae90b38d78c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d78bc expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596633.691678:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8c1482c00/0x8973ae90b38d78c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d78bc expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596633.691686:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c1482c00, rc 0) 00000100:00100000:2.0:1789596633.691740:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964770560:12345-0@lo:101: Request processed in 119us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596633.691747:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789596633.691901:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5780e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964770560:0@lo:101: 00010000:00010000:0.0:1789596633.691915:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8600/0x8973ae90b38d78bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d78c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596633.691924:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8600/0x8973ae90b38d78bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d78c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596633.691987:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964770688:0@lo:256: 00000100:00100000:0.0:1789596633.692019:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596633.697437:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6a036c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596633.704390:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964770688 00000100:00100000:1.0:1789596633.704408:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964770688 00000100:00100000:1.0:1789596633.704885:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789596633.704898:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964770688:12345-0@lo:256: 20000000:01000000:1.0:1789596633.704926:0:5836:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789596633.704951:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789596633.704954:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789596633.706459:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964770688:12345-0@lo:256: Request processed in 1559us (14433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596633.706487:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789596633.710489:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964770688:0@lo:256: 10000000:01000000:0.0:1789596633.710561:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789596633.710572:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8600/0x8973ae90b38d78bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d78c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596633.710583:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8600/0x8973ae90b38d78bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d78c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596633.710594:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789596633.710597:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789596633.710600:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789596633.710634:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d78ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596633.710642:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d78ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596633.710661:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d78ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596633.710678:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964770816:0@lo:101: 00000100:00100000:0.0:1789596633.711253:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596633.711316:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6a036c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596633.711781:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964770816 00000100:00100000:3.0:1789596633.711789:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964770816 00000100:00100000:3.0:1789596633.711860:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789596633.711872:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964770816:12345-0@lo:101: 00010000:00010000:3.0:1789596633.711887:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596633.711901:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f89e00/0x8973ae90b38d78d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d78ca expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596633.711923:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f89e00/0x8973ae90b38d78d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d78ca expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596633.711934:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f89e00/0x8973ae90b38d78d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d78ca expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596633.711942:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89e00, rc 0) 00000100:00100000:3.0:1789596633.712005:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964770816:12345-0@lo:101: Request processed in 136us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596633.712011:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789596633.712164:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964770816:0@lo:101: 00010000:00010000:1.0:1789596633.712180:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d78ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d78d1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596633.712189:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d78ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d78d1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596633.712260:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5783800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964770944:0@lo:501: 00000100:00100000:1.0:1789596633.712302:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596633.712330:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c3157240 going to sleep for 11 seconds 00000100:00100000:2.0:1789596633.712441:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964770944 00000100:00100000:2.0:1789596633.712452:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964770944 00000100:00100000:2.0:1789596633.712499:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789596633.712506:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964770944:12345-0@lo:501: 00000100:00100000:2.0:1789596633.712751:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964770944:12345-0@lo:501: Request processed in 244us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596633.712759:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789596633.713091:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5783800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964770944:0@lo:501: 00000100:00100000:1.0:1789596633.713124:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5783800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964771072:0@lo:503: 00000100:00100000:1.0:1789596633.713163:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596633.713192:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c3157240 going to sleep for 11 seconds 00000100:00100000:3.0:1789596633.713252:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964771072 00000100:00100000:3.0:1789596633.713257:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964771072 00000100:00100000:3.0:1789596633.713301:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789596633.713307:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964771072:12345-0@lo:503: 00000100:00100000:3.0:1789596633.713603:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964771072:12345-0@lo:503: Request processed in 295us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596633.713617:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789596633.713905:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5783800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964771072:0@lo:503: 00000100:00100000:1.0:1789596633.714566:0:8103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5783800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8103:1876527964771200:0@lo:502: 00000100:00100000:1.0:1789596633.714613:0:8103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596633.714647:0:8103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c31573c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596633.714850:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964771200 00000100:00100000:3.0:1789596633.714856:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964771200 00000100:00100000:3.0:1789596633.714895:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789596633.714903:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:8103:x1876527964771200:12345-0@lo:502: 00000100:00100000:3.0:1789596633.715177:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:8103:x1876527964771200:12345-0@lo:502: Request processed in 275us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596633.715184:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789596633.715430:0:8103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5783800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8103:1876527964771200:0@lo:502: 00000020:01000000:2.0:1789596633.715459:0:8103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789596633.715482:0:8103:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789596633.715489:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596633.715491:0:8103:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789596633.715497:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789596633.715501:0:8103:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.144@tcp to nid 0x20000c0a8ca90 (192.168.202.144@tcp) 00000020:01000000:2.0:1789596633.715522:0:8103:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789596633.715526:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789596633.715549:0:8103:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ea8ffa84d40) 00000020:00000080:2.0:1789596633.715569:0:8103:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789596633.715576:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789596633.715639:0:8103:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789596633.715645:0:8103:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789596633.715650:0:8103:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8973ae90b38d78df 00010000:00080000:2.0:1789596633.715677:0:8103:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ea8ffa3b000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.144@tcp at head 00010000:00010000:2.0:1789596633.715931:0:8103:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1789596633.716459:0:8103:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789596633.716484:0:8103:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789596633.718082:0:8103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789596633.718419:0:8103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789596633.718812:0:8103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789596633.719093:0:8103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789596633.722333:0:8104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789596633.722341:0:8104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789596633.723438:0:8103:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789596633.723458:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789596633.723509:0:8103:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789596633.723532:0:8103:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8973ae90b38d78e6 00000100:00080000:2.0:1789596633.723543:0:8103:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789596633.723555:0:8103:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ea8ffa3b000 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:2.0:1789596633.723589:0:8103:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ea90000bb80 x1876527964771328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789596633.723607:0:8103:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789596633.723662:0:8103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596633.723666:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596633.723668:0:8103:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789596633.723670:0:8103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596633.723674:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596633.723675:0:8103:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789596633.723678:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789596633.723680:0:8103:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789596633.723715:0:8103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8103:1876527964771456:0@lo:502: 00000100:00100000:2.0:1789596633.723798:0:8103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596633.723861:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964771456 00000100:00100000:2.0:1789596633.723868:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964771456 00000100:00100000:2.0:1789596633.723907:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789596633.723915:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:8103:x1876527964771456:12345-0@lo:502: 00000100:00100000:0.0:1789596633.724374:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876527964771584:0@lo:400: 00000100:00100000:0.0:1789596633.724408:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596633.724447:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964771712:0@lo:400: 00000100:00100000:0.0:1789596633.724482:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596633.724501:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596633.724507:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964771840:0@lo:400: 00000100:00100000:0.0:1789596633.724527:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596633.724693:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964771328:0@lo:8: 00000100:00100000:1.0:1789596633.724745:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596633.725952:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:8103:x1876527964771456:12345-0@lo:502: Request processed in 2032us (2148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596633.725964:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789596633.726111:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964771328 00000100:00100000:0.0:1789596633.726119:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964771328 00000100:00100000:0.0:1789596633.726152:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789596633.726159:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876527964771328:12345-0@lo:8: 00010000:00080000:0.0:1789596633.726185:0:6693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:0.0:1789596633.726213:0:6693:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8973ae90b38d78ed 00002000:00100000:0.0:1789596633.726226:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ea8c86d2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789596633.726230:0:6693:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1789596633.726234:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789596633.726339:0:6693:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789596633.726508:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789596633.726532:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9ea8f90ef000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596633.726579:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876527964771328:12345-0@lo:8: Request processed in 419us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596633.726586:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789596633.726775:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964771584 00000100:00100000:2.0:1789596633.726780:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964771584 00000100:00100000:2.0:1789596633.726804:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964771712 00000100:00100000:2.0:1789596633.726807:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964771712 00000100:00100000:2.0:1789596633.726873:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964771840 00000100:00100000:2.0:1789596633.726876:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964771840 00000100:00100000:2.0:1789596633.726891:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789596633.726897:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876527964771584:12345-0@lo:400: 00000100:00100000:2.0:1789596633.726944:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876527964771584:12345-0@lo:400: Request processed in 46us (2535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596633.726950:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789596633.726961:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789596633.727403:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea90000bb80 x1876527964771328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789596643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596633.727414:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789596633.727420:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789596633.727429:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789596633.727433:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789596633.727436:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8ffa3b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789596633.727447:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789596633.727451:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964771328:0@lo:8: 00000100:00100000:2.0:1789596633.727513:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964771712:12345-0@lo:400: 00000100:00100000:2.0:1789596633.727564:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964771712:12345-0@lo:400: Request processed in 597us (3080us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596633.727570:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789596633.727584:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789596633.727591:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964771840:12345-0@lo:400: 00000100:00100000:2.0:1789596633.727618:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964771840:12345-0@lo:400: Request processed in 28us (3090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596633.727623:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789596633.727658:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8fa252300 x1876527964771584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596633.727669:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa252300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876527964771584:0@lo:400: 00000100:00100000:2.0:1789596633.727698:0:8103:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596633.727721:0:8103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8103:1876527964771456:0@lo:502: 00000100:00080000:0.0:1789596633.728013:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789596633.728026:0:8104:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789596633.728140:0:8104:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 218692323235ns, next at 0ns, rc = 0 00000020:01000000:2.0:1789596633.729180:0:8103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596633.729190:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596633.729193:0:8103:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789596633.729198:0:8103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00010000:00080000:1.0:1789596633.729870:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8fa251180 x1876527964771840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596633.729894:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964771840:0@lo:400: 00010000:00080000:1.0:1789596633.729911:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8fa251500 x1876527964771712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596633.730416:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964771712:0@lo:400: 00000020:01000000:0.0:1789596633.733341:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789596633.733376:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789596633.733387:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d78ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d78d1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596633.733398:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d78ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d78d1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596633.733408:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789596633.733410:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ea8c2ca3380 from 1 10000000:01000000:0.0:1789596633.733413:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789596633.733458:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031c00/0x8973ae90b38d78f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596633.733479:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031c00/0x8973ae90b38d78f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596633.733490:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031c00/0x8973ae90b38d78f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596633.733516:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa252680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964771968:0@lo:101: 00000100:00100000:0.0:1789596633.733585:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596633.733641:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6a033c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596633.734253:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964771968 00000100:00100000:3.0:1789596633.734261:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964771968 00000100:00100000:3.0:1789596633.734307:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789596633.734316:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964771968:12345-0@lo:101: 00010000:00010000:3.0:1789596633.734331:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596633.734345:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d78fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d78f4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596633.734367:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d78fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d78f4 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596633.734377:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d78fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d78f4 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596633.734385:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89800, rc 0) 00000100:00100000:3.0:1789596633.734440:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964771968:12345-0@lo:101: Request processed in 125us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596633.734447:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789596633.734714:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa252680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964771968:0@lo:101: 00010000:00010000:3.0:1789596633.734751:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031c00/0x8973ae90b38d78f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d78fb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596633.734760:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031c00/0x8973ae90b38d78f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d78fb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596633.734833:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964772096:0@lo:501: 00000100:00100000:3.0:1789596633.734860:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596633.734876:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c56d3180 going to sleep for 11 seconds 00000100:00100000:3.0:1789596633.734890:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964772096 00000100:00100000:3.0:1789596633.734893:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964772096 00000100:00100000:3.0:1789596633.734915:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789596633.734921:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964772096:12345-0@lo:501: 00000100:00100000:3.0:1789596633.735965:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964772096:12345-0@lo:501: Request processed in 1039us (1099us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789596633.737098:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789596633.737165:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964772096:0@lo:501: 10000000:01000000:3.0:1789596633.737202:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789596633.737212:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031c00/0x8973ae90b38d78f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d78fb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596633.737221:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031c00/0x8973ae90b38d78f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d78fb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789596633.808378:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789596633.863595:0:8105:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789596633.863629:0:8105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5783b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8105:1876527964772352:0@lo:7: 00000100:00100000:1.0:1789596633.863695:0:8105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596633.863770:0:8105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c3157cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596633.863786:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789596633.863797:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964772224:0@lo:13: 00000100:00100000:1.0:1789596633.863854:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596633.863886:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964772352 00000100:00100000:1.0:1789596633.863894:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964772352 00000100:00100000:1.0:1789596633.863948:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789596633.863957:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8105:x1876527964772352:12345-0@lo:7: 00000100:00100000:2.0:1789596633.866023:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964772224 00000100:00100000:2.0:1789596633.866038:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964772224 00000100:00100000:2.0:1789596633.866096:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789596633.866107:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876527964772224:12345-0@lo:13: 00002000:00000024:2.0:1789596633.866134:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1789596633.866213:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876527964772224:12345-0@lo:13: Request processed in 108us (2358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596633.866219:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789596633.866427:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789596633.875178:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c5782300 x1876527964772224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596649 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596633.875206:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964772224:0@lo:13: 00002000:00080000:1.0:1789596633.877109:0:6692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789596633.877117:0:6692:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789596633.877341:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8105:x1876527964772352:12345-0@lo:7: Request processed in 13381us (13641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596633.877351:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789596633.879131:0:8105:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c5783b80 x1876527964772352/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789596649 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596633.879149:0:8105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5783b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8105:1876527964772352:0@lo:7: 00000004:00080000:0.0:1789596633.879164:0:8105:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789596633.881285:0:8105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5781880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8105:1876527964772480:0@lo:5: 00000100:00100000:1.0:1789596633.881356:0:8105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596633.881420:0:8105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c3157480 going to sleep for 11 seconds 00000100:00100000:2.0:1789596633.881682:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964772480 00000100:00100000:2.0:1789596633.881690:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964772480 00000100:00100000:2.0:1789596633.881757:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789596633.881767:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8105:x1876527964772480:12345-0@lo:5: 00002000:00080000:2.0:1789596633.881792:0:6695:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789596633.881796:0:6695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789596633.882167:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8105:x1876527964772480:12345-0@lo:5: Request processed in 401us (811us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789596633.882175:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789596633.882455:0:8105:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c5781880 x1876527964772480/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789596649 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596633.882500:0:8105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5781880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8105:1876527964772480:0@lo:5: 00000004:00080000:1.0:1789596633.882512:0:8105:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789596633.882540:0:8105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5780700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8105:1876527964772608:0@lo:700: 00000100:00100000:1.0:1789596633.882568:0:8105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596633.882597:0:8105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c3157480 going to sleep for 11 seconds 00000100:00100000:3.0:1789596633.882899:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964772608 00000100:00100000:3.0:1789596633.882905:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964772608 00000100:00100000:3.0:1789596633.882941:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789596633.882956:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8105:x1876527964772608:12345-0@lo:700: 00000100:00100000:3.0:1789596633.882998:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6701:1876527964772736:0@lo:700: 00000100:00100000:3.0:1789596633.883027:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596633.883045:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c56d3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596633.883075:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964772736 00000100:00100000:3.0:1789596633.883079:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964772736 00000100:00100000:3.0:1789596633.883105:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789596633.883111:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6701:x1876527964772736:12345-0@lo:700: 00010000:00010000:0.0:1789596633.886558:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:3.0:1789596633.936255:0:5848:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1789596633.945420:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6701:x1876527964772736:12345-0@lo:700: Request processed in 62299us (62382us total) trans 0 rc 0/0 00010000:00080000:1.0:1789596633.945558:0:6701:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c6ec0700 x1876527964772736/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789596649 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596633.945575:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6701:1876527964772736:0@lo:700: 40000000:02000000:1.0:1789596633.945589:0:6701:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:3.0:1789596633.948426:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:0.0:1789596634.093684:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789596634.093956:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1789596634.094280:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8105:x1876527964772608:12345-0@lo:700: Request processed in 211321us (211706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596634.094294:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789596634.094389:0:8105:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c5780700 x1876527964772608/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789596649 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596634.094401:0:8105:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789596634.094424:0:8105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5780700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8105:1876527964772608:0@lo:700: 00000004:02000040:0.0:1789596634.229322:0:8105:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1789596634.237952:0:8105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa252680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8105:1876527964772864:0@lo:5: 00000100:00100000:0.0:1789596634.238400:0:8105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596634.238518:0:8105:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6a033c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596634.238654:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964772864 00000100:00100000:1.0:1789596634.238664:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964772864 00000100:00100000:1.0:1789596634.239080:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789596634.239092:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8105:x1876527964772864:12345-0@lo:5: 00002000:00080000:3.0:1789596634.248670:0:6692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789596634.248692:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789596634.255855:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8105:x1876527964772864:12345-0@lo:5: Request processed in 16757us (17447us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789596634.255868:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789596634.256017:0:8105:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8fa252680 x1876527964772864/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789596650 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596634.256036:0:8105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa252680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8105:1876527964772864:0@lo:5: 00000004:00080000:2.0:1789596634.256051:0:8105:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1789596634.906972:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789596635.698435:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1789596635.937136:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596636.957627:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596637.164731:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596637.164888:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944827264 00000100:00100000:3.0:1789596637.164902:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944827264 00000100:00100000:3.0:1789596637.164957:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 111 00000100:00100000:3.0:1789596637.164966:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2350:x1876527944827264:12345-192.168.202.44@tcp:250: 00010000:00080000:3.0:1789596637.164995:0:5834:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from d497c431-e5b0-455f-b1ef-a9fda826a9b9@192.168.202.44@tcp t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:3.0:1789596637.165028:0:5834:0:(genops.c:1384:class_connect()) connect: client d497c431-e5b0-455f-b1ef-a9fda826a9b9, cookie 0x8973ae90b38d7902 00000100:00080000:3.0:1789596637.165178:0:5834:0:(import.c:65:import_set_state_nolock()) ffff9ea900074800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789596637.165255:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+5:2350:x1876527944827264:12345-192.168.202.44@tcp:250: Request processed in 288us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596637.165284:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 111 00000100:00100000:2.0:1789596637.170763:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596637.170969:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944827136 00000100:00100000:3.0:1789596637.170981:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944827136 00000100:00100000:3.0:1789596637.171045:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 112 00000100:00100000:3.0:1789596637.171054:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+5:5578:x1876527944827136:12345-192.168.202.44@tcp:101: 00010000:00010000:3.0:1789596637.171071:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596637.171090:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f88c00/0x8973ae90b38d7909 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344c20 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596637.171122:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f88c00/0x8973ae90b38d7909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c20 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596637.171133:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f88c00/0x8973ae90b38d7909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c20 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596637.171143:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88c00, rc 0) 00000100:00100000:3.0:1789596637.171208:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+6:5578:x1876527944827136:12345-192.168.202.44@tcp:101: Request processed in 154us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596637.171215:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 112 00000100:00100000:1.0:1789596637.173384:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596637.173474:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944827392 00000100:00100000:3.0:1789596637.173484:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944827392 00000100:00100000:3.0:1789596637.173543:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 113 00000100:00100000:3.0:1789596637.173553:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+6:5578:x1876527944827392:12345-192.168.202.44@tcp:501: 00000100:00100000:3.0:1789596637.174250:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+6:5578:x1876527944827392:12345-192.168.202.44@tcp:501: Request processed in 691us (867us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789596637.174260:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 113 00000100:00100000:1.0:1789596637.181650:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596637.182012:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944827520 00000100:00100000:3.0:1789596637.182036:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944827520 00000100:00100000:3.0:1789596637.182098:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 114 00000100:00100000:3.0:1789596637.182109:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+6:5578:x1876527944827520:12345-192.168.202.44@tcp:101: 00010000:00010000:3.0:1789596637.182126:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596637.182144:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7910 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344c27 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596637.182172:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c27 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596637.182184:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c27 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596637.182193:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88800, rc 0) 00000100:00100000:3.0:1789596637.182255:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+7:5578:x1876527944827520:12345-192.168.202.44@tcp:101: Request processed in 147us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596637.182262:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 114 00000100:00100000:2.0:1789596637.189257:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596637.189624:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944827648 00000100:00100000:3.0:1789596637.189635:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944827648 00000100:00100000:3.0:1789596637.189867:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 115 00000100:00100000:3.0:1789596637.189878:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+7:5578:x1876527944827648:12345-192.168.202.44@tcp:501: 00000100:00100000:3.0:1789596637.190273:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+8:5578:x1876527944827648:12345-192.168.202.44@tcp:501: Request processed in 396us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596637.190282:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 115 00000100:00100000:1.0:1789596637.198351:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596637.198452:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944827776 00000100:00100000:0.0:1789596637.198463:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944827776 00000100:00100000:0.0:1789596637.198562:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 116 00000100:00100000:0.0:1789596637.198573:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+8:5578:x1876527944827776:12345-192.168.202.44@tcp:503: 00000100:00100000:0.0:1789596637.199280:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+8:5578:x1876527944827776:12345-192.168.202.44@tcp:503: Request processed in 705us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596637.199289:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 116 00000100:00100000:1.0:1789596637.203383:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596637.203589:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944827904 00000100:00100000:0.0:1789596637.203601:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944827904 00000100:00100000:0.0:1789596637.203666:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 117 00000100:00100000:0.0:1789596637.203686:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+8:5596:x1876527944827904:12345-192.168.202.44@tcp:502: 00000100:00100000:0.0:1789596637.204298:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+8:5596:x1876527944827904:12345-192.168.202.44@tcp:502: Request processed in 611us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596637.204307:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 117 00000100:00100000:2.0:1789596637.254126:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596637.254242:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944828032 00000100:00100000:0.0:1789596637.254253:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944828032 00000100:00100000:0.0:1789596637.254313:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 118 00000100:00100000:0.0:1789596637.254322:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+8:5596:x1876527944828032:12345-192.168.202.44@tcp:502: 00000100:00100000:0.0:1789596637.254928:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+8:5596:x1876527944828032:12345-192.168.202.44@tcp:502: Request processed in 603us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596637.254937:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 118 00000100:00100000:1.0:1789596637.265277:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596637.266328:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944828160 00000100:00100000:3.0:1789596637.266341:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944828160 00000100:00100000:3.0:1789596637.266414:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 119 00000100:00100000:3.0:1789596637.266425:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+8:5578:x1876527944828160:12345-192.168.202.44@tcp:101: 00010000:00010000:3.0:1789596637.266455:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596637.266472:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f88200/0x8973ae90b38d7917 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344c51 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596637.266500:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f88200/0x8973ae90b38d7917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c51 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596637.266512:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f88200/0x8973ae90b38d7917 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c51 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596637.266521:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88200, rc 0) 00000100:00100000:3.0:1789596637.266585:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+9:5578:x1876527944828160:12345-192.168.202.44@tcp:101: Request processed in 162us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596637.266601:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 119 00000100:00100000:1.0:1789596637.272955:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596637.273297:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944828288 00000100:00100000:3.0:1789596637.273306:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944828288 00000100:00100000:3.0:1789596637.273368:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 120 00000100:00100000:3.0:1789596637.273378:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+9:5578:x1876527944828288:12345-192.168.202.44@tcp:256: 20000000:01000000:3.0:1789596637.273414:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789596637.273435:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789596637.273439:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789596637.273443:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789596637.273445:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1789596637.276907:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+9:5578:x1876527944828288:12345-192.168.202.44@tcp:256: Request processed in 3518us (3949us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596637.276928:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 120 00000100:00100000:1.0:1789596637.280559:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596637.280909:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944828416 00000100:00100000:0.0:1789596637.280921:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944828416 00000100:00100000:0.0:1789596637.281024:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 121 00000100:00100000:0.0:1789596637.281035:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+9:5578:x1876527944828416:12345-192.168.202.44@tcp:101: 00010000:00010000:0.0:1789596637.281052:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596637.281069:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d791e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344c58 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596637.281097:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d791e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c58 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596637.281124:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d791e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c58 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596637.281133:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0031a00, rc 0) 00000100:00100000:0.0:1789596637.281231:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:5578:x1876527944828416:12345-192.168.202.44@tcp:101: Request processed in 196us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596637.281238:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 121 00000100:00100000:2.0:1789596637.284207:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596637.284302:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944828544 00000100:00100000:3.0:1789596637.284313:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944828544 00000100:00100000:3.0:1789596637.284421:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 122 00000100:00100000:3.0:1789596637.284431:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:5578:x1876527944828544:12345-192.168.202.44@tcp:501: 00000100:00100000:3.0:1789596637.285022:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:5578:x1876527944828544:12345-192.168.202.44@tcp:501: Request processed in 591us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596637.285031:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 122 00000100:00100000:1.0:1789596637.287582:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596637.288050:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944828672 00000100:00100000:0.0:1789596637.288062:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944828672 00000100:00100000:0.0:1789596637.288151:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 123 00000100:00100000:0.0:1789596637.288160:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:5578:x1876527944828672:12345-192.168.202.44@tcp:503: 00000100:00100000:0.0:1789596637.290974:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:5578:x1876527944828672:12345-192.168.202.44@tcp:503: Request processed in 2804us (3390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596637.290990:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 123 00000100:00100000:1.0:1789596637.294464:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596637.295015:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944828800 00000100:00100000:2.0:1789596637.295026:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944828800 00000100:00100000:2.0:1789596637.295077:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 124 00000100:00100000:2.0:1789596637.295101:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:5601:x1876527944828800:12345-192.168.202.44@tcp:502: 00000100:00100000:2.0:1789596637.295509:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:5601:x1876527944828800:12345-192.168.202.44@tcp:502: Request processed in 408us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596637.295517:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 124 00000100:00100000:0.0:1789596637.298062:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596637.298144:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944828928 00000100:00100000:3.0:1789596637.298153:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944828928 00000100:00100000:3.0:1789596637.298201:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 125 00000100:00100000:3.0:1789596637.298211:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:5601:x1876527944828928:12345-192.168.202.44@tcp:502: 00000100:00100000:3.0:1789596637.298689:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:5601:x1876527944828928:12345-192.168.202.44@tcp:502: Request processed in 478us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596637.298697:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 125 00000100:00100000:1.0:1789596637.305928:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596637.306070:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944829056 00000100:00100000:3.0:1789596637.306080:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944829056 00000100:00100000:3.0:1789596637.306138:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 4 00000100:00100000:3.0:1789596637.306146:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2350:x1876527944829056:12345-192.168.202.44@tcp:38: 00010000:00080000:3.0:1789596637.306176:0:5842:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:3.0:1789596637.306222:0:5842:0:(genops.c:1384:class_connect()) connect: client 1fdd0e7b-fe25-4537-b350-ae6aecfab059, cookie 0x8973ae90b38d7925 00000004:00100000:3.0:1789596637.306254:0:5842:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789596637.306261:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1789596637.349796:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9ea900070800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789596637.349943:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2350:x1876527944829056:12345-192.168.202.44@tcp:38: Request processed in 43794us (44024us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596637.349953:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 4 00010000:00010000:0.0:1789596637.980224:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596638.235219:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596638.235240:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964772992:0@lo:13: 00000100:00100000:3.0:1789596638.235310:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596638.235519:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964772992 00000100:00100000:2.0:1789596638.235527:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964772992 00000100:00100000:2.0:1789596638.235578:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789596638.235585:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964772992:12345-0@lo:13: 00002000:00000024:2.0:1789596638.235615:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789596638.235670:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964772992:12345-0@lo:13: Request processed in 76us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596638.235677:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789596638.235742:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c5781500 x1876527964772992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596654 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789596638.235743:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596638.235764:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964772992:0@lo:13: 00000100:00100000:1.0:1789596638.360810:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596638.360930:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944829184 00000100:00100000:2.0:1789596638.360940:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944829184 00000100:00100000:2.0:1789596638.361073:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 5 00000100:00100000:2.0:1789596638.361084:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:0:x1876527944829184:12345-192.168.202.44@tcp:41: 00000004:00000024:2.0:1789596638.361128:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789596638.361197:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:0:x1876527944829184:12345-192.168.202.44@tcp:41: Request processed in 114us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596638.361204:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 5 00000100:00080000:3.0:1789596638.361722:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596638.362076:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596638.363065:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944829312 00000100:00100000:0.0:1789596638.363076:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944829312 00000100:00100000:0.0:1789596638.363116:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 6 00000100:00100000:0.0:1789596638.363125:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:5578:x1876527944829312:12345-192.168.202.44@tcp:41: 00000004:00000024:0.0:1789596638.363153:0:5841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789596638.363746:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:5578:x1876527944829312:12345-192.168.202.44@tcp:41: Request processed in 618us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596638.363768:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 6 00000100:00100000:1.0:1789596638.368653:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596638.368779:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944829440 00000100:00100000:0.0:1789596638.368791:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944829440 00000100:00100000:0.0:1789596638.368887:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 7 00000100:00100000:0.0:1789596638.368898:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:5578:x1876527944829440:12345-192.168.202.44@tcp:40: 00000100:00100000:0.0:1789596638.368990:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:5578:x1876527944829440:12345-192.168.202.44@tcp:40: Request processed in 94us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596638.368997:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 7 00000100:00100000:1.0:1789596638.372018:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596638.372078:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596638.372230:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944829568 00000100:00100000:0.0:1789596638.372241:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944829568 00000100:00100000:0.0:1789596638.372291:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 8 00000100:00100000:0.0:1789596638.372300:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1876527944829568:12345-192.168.202.44@tcp:8: 00010000:00080000:0.0:1789596638.372330:0:6693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:0.0:1789596638.372365:0:6693:0:(genops.c:1384:class_connect()) connect: client 1fdd0e7b-fe25-4537-b350-ae6aecfab059, cookie 0x8973ae90b38d792c 00002000:00100000:0.0:1789596638.372378:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1fdd0e7b-fe25-4537-b350-ae6aecfab059/ffff9ea8f9f60800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789596638.372388:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789596638.373140:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789596638.373174:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9ea8f9f61800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596638.373249:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2350:x1876527944829568:12345-192.168.202.44@tcp:8: Request processed in 948us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596638.373258:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 8 00000100:00100000:3.0:1789596638.373639:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944829824 00000100:00100000:3.0:1789596638.373646:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944829824 00000100:00100000:3.0:1789596638.373702:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 126 00000100:00100000:3.0:1789596638.373710:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2354:x1876527944829824:12345-192.168.202.44@tcp:400: 00000100:00100000:3.0:1789596638.373742:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2354:x1876527944829824:12345-192.168.202.44@tcp:400: Request processed in 34us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596638.373748:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 126 00000100:00100000:1.0:1789596638.376236:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596638.376318:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944829696 00000100:00100000:3.0:1789596638.376328:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944829696 00000100:00100000:3.0:1789596638.376372:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 9 00000100:00100000:3.0:1789596638.376380:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1876527944829696:12345-192.168.202.44@tcp:8: 00010000:00080000:3.0:1789596638.376421:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:3.0:1789596638.376454:0:6692:0:(genops.c:1384:class_connect()) connect: client 1fdd0e7b-fe25-4537-b350-ae6aecfab059, cookie 0x8973ae90b38d7933 00002000:00100000:3.0:1789596638.376467:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1fdd0e7b-fe25-4537-b350-ae6aecfab059/ffff9ea900073800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789596638.376489:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789596638.377030:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789596638.377059:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9ea900071000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789596638.377127:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2350:x1876527944829696:12345-192.168.202.44@tcp:8: Request processed in 746us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596638.377135:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 9 00000100:00100000:1.0:1789596638.380547:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596638.380761:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944829952 00000100:00100000:2.0:1789596638.380772:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944829952 00000100:00100000:2.0:1789596638.380880:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 0 00000100:00100000:2.0:1789596638.380892:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:5578:x1876527944829952:12345-192.168.202.44@tcp:33: 00000004:00080000:2.0:1789596638.394490:0:5844:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 13525us 00000004:00200000:2.0:1789596638.406176:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789596638.406309:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:5578:x1876527944829952:12345-192.168.202.44@tcp:33: Request processed in 25415us (25767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596638.406320:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 0 00000100:00100000:1.0:1789596638.622002:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596638.622268:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944830080 00000100:00100000:3.0:1789596638.622280:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944830080 00000100:00100000:3.0:1789596638.622347:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 8 00000100:00100000:3.0:1789596638.622366:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:5619:x1876527944830080:12345-192.168.202.44@tcp:101: 00010000:00010000:3.0:1789596638.622387:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596638.622475:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89a00/0x8973ae90b38d793a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344c82 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596638.622542:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89400/0x8973ae90b38d7941 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596638.622557:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89400/0x8973ae90b38d7941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596638.622572:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89400/0x8973ae90b38d7941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596638.622626:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789596638.622630:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789596638.622650:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89400/0x8973ae90b38d7941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596638.622683:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89a00/0x8973ae90b38d793a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c82 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596638.622703:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89400/0x8973ae90b38d7941 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c82 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596638.622711:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8d1438d00) 00010000:00010000:3.0:1789596638.622713:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789596638.622716:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89400, rc 0) 00000100:00100000:3.0:1789596638.622767:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:5619:x1876527944830080:12345-192.168.202.44@tcp:101: Request processed in 405us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596638.622780:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 8 00000100:00100000:1.0:1789596638.747151:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964773120:0@lo:400: 00000100:00100000:1.0:1789596638.747232:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596638.747515:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964773632:0@lo:400: 00000100:00100000:1.0:1789596638.747546:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596638.747567:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596638.747572:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964773248:0@lo:400: 00000100:00100000:1.0:1789596638.747611:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596638.747674:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964773248 00000100:00100000:1.0:1789596638.747682:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964773248 00000100:00100000:1.0:1789596638.747725:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789596638.747734:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964773248:12345-0@lo:400: 00000100:00100000:1.0:1789596638.747787:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964773248:12345-0@lo:400: Request processed in 54us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596638.747794:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789596638.747875:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964773248:0@lo:400: 00000100:00100000:0.0:1789596638.748066:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964773504:0@lo:400: 00000100:00100000:0.0:1789596638.748099:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596638.748129:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596638.748135:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964773376:0@lo:400: 00000100:00100000:0.0:1789596638.748164:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596638.748193:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964773632 00000100:00100000:0.0:1789596638.748197:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964773632 00000100:00100000:0.0:1789596638.748236:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789596638.748242:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964773632:12345-0@lo:400: 00000100:00100000:0.0:1789596638.748278:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964773632:12345-0@lo:400: Request processed in 36us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596638.748284:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789596638.748461:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789596638.748477:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964773504 00000100:00100000:3.0:1789596638.748481:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964773504 00000100:00100000:3.0:1789596638.748519:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964773376 00000100:00100000:3.0:1789596638.748523:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964773376 00000100:00100000:3.0:1789596638.748540:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789596638.748546:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964773504:12345-0@lo:400: 00000100:00100000:3.0:1789596638.748694:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964773504:12345-0@lo:400: Request processed in 42us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596638.748703:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789596638.748719:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789596638.748725:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964773376:12345-0@lo:400: 00000100:00100000:3.0:1789596638.748756:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964773376:12345-0@lo:400: Request processed in 31us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596638.748762:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789596638.748794:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964773376:0@lo:400: 00000100:00100000:3.0:1789596638.748804:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964773504:0@lo:400: 00000100:00080000:0.0:1789596638.748920:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789596638.753915:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8f6525500 x1876527964773632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596638.753932:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789596638.753953:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964773632:0@lo:400: 00000100:00100000:2.0:1789596638.754520:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964773120 00000100:00100000:2.0:1789596638.754529:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964773120 00000100:00100000:2.0:1789596638.754613:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789596638.754622:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964773120:12345-0@lo:400: 00000100:00100000:2.0:1789596638.754722:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964773120:12345-0@lo:400: Request processed in 100us (7490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596638.754728:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789596638.754899:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964773120:0@lo:400: 00010000:00010000:1.0:1789596639.003169:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596639.259142:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964773760:0@lo:13: 00000100:00100000:0.0:1789596639.259216:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596639.259363:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964773760 00000100:00100000:3.0:1789596639.259371:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964773760 00000100:00100000:3.0:1789596639.259432:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789596639.259443:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964773760:12345-0@lo:13: 00002000:00000024:3.0:1789596639.259466:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596639.259523:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964773760:12345-0@lo:13: Request processed in 82us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596639.259530:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789596639.259748:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea900009180 x1876527964773760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596639.259772:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964773760:0@lo:13: 00000001:00100000:2.0:1789596639.829022:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1fdd0e7b-fe25-4537-b350-ae6aecfab059 00010000:00010000:0.0:1789596640.032352:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596640.719499:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596640.721260:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944830208 00000100:00100000:0.0:1789596640.721274:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944830208 00000100:00100000:1.0:1789596640.721565:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 9 00000100:00100000:1.0:1789596640.721580:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:5671:x1876527944830208:12345-192.168.202.44@tcp:41: 00000004:00000024:1.0:1789596640.721624:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789596640.721743:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:5671:x1876527944830208:12345-192.168.202.44@tcp:41: Request processed in 167us (2251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596640.721751:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 9 00000100:00080000:3.0:1789596640.722346:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596640.725914:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596640.726212:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944830336 00000100:00100000:3.0:1789596640.726222:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944830336 00000100:00100000:3.0:1789596640.726303:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 8 00000100:00100000:3.0:1789596640.726314:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:5671:x1876527944830336:12345-192.168.202.44@tcp:13: 00002000:00000024:3.0:1789596640.726350:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596640.726423:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:5671:x1876527944830336:12345-192.168.202.44@tcp:13: Request processed in 110us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596640.726431:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 8 00000100:00080000:0.0:1789596640.727025:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596640.729168:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596640.729335:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944830464 00000100:00100000:3.0:1789596640.729349:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944830464 00000100:00100000:3.0:1789596640.729430:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 9 00000100:00100000:3.0:1789596640.729441:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:5671:x1876527944830464:12345-192.168.202.44@tcp:13: 00002000:00000024:3.0:1789596640.729486:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596640.729574:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:5671:x1876527944830464:12345-192.168.202.44@tcp:13: Request processed in 134us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596640.729581:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 9 00000100:00080000:0.0:1789596640.729772:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789596641.051053:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789596641.860343:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1fdd0e7b-fe25-4537-b350-ae6aecfab059 00010000:00010000:1.0:1789596642.075314:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789596642.378208:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1fdd0e7b-fe25-4537-b350-ae6aecfab059 00000001:02000400:2.0:1789596643.018415:0:8310:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789596643.108500:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596643.355572:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596643.355606:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964773888:0@lo:13: 00000100:00100000:3.0:1789596643.355684:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596643.355837:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964773888 00000100:00100000:1.0:1789596643.355846:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964773888 00000100:00100000:1.0:1789596643.355908:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789596643.355917:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964773888:12345-0@lo:13: 00002000:00000024:1.0:1789596643.355949:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789596643.355994:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964773888:12345-0@lo:13: Request processed in 78us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596643.356001:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789596643.356078:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789596643.356110:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8fa1c7100 x1876527964773888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596659 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596643.356128:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964773888:0@lo:13: 00000100:00100000:1.0:1789596643.688743:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596643.688786:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596643.688813:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596643.688862:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596643.688890:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944830848 00000100:00100000:1.0:1789596643.688900:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944830848 00000100:00100000:1.0:1789596643.688959:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944830976 00000100:00100000:1.0:1789596643.688963:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944830976 00000100:00100000:1.0:1789596643.688981:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 4 00000100:00100000:1.0:1789596643.688989:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2354:x1876527944830848:12345-192.168.202.44@tcp:400: 00000100:00100000:0.0:1789596643.689368:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944830592 00000100:00100000:0.0:1789596643.689374:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944830592 00000100:00100000:0.0:1789596643.689412:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 128 00000100:00100000:0.0:1789596643.689419:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2354:x1876527944830592:12345-192.168.202.44@tcp:400: 00000100:00100000:1.0:1789596643.690290:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2354:x1876527944830848:12345-192.168.202.44@tcp:400: Request processed in 1295us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596643.690301:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 4 00000100:00100000:1.0:1789596643.690331:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 5 00000100:00100000:1.0:1789596643.690351:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2354:x1876527944830976:12345-192.168.202.44@tcp:400: 00000100:00100000:0.0:1789596643.696439:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2354:x1876527944830592:12345-192.168.202.44@tcp:400: Request processed in 7009us (7695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596643.696453:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 128 00000100:00080000:0.0:1789596643.696532:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789596643.696546:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596643.696567:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944830720 00000100:00100000:0.0:1789596643.696576:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944830720 00000100:00100000:0.0:1789596643.696647:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 20 00000100:00100000:0.0:1789596643.696658:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2354:x1876527944830720:12345-192.168.202.44@tcp:400: 00000100:00100000:0.0:1789596643.696728:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2354:x1876527944830720:12345-192.168.202.44@tcp:400: Request processed in 73us (7915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596643.696735:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 20 00000100:00080000:0.0:1789596643.696751:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596643.697452:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2354:x1876527944830976:12345-192.168.202.44@tcp:400: Request processed in 7109us (8584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596643.697462:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 5 00000100:00100000:1.0:1789596643.869682:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964774144:0@lo:400: 00000100:00100000:1.0:1789596643.869755:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596643.869812:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596643.869853:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964774272:0@lo:400: 00000100:00100000:1.0:1789596643.869877:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596643.869915:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964774144 00000100:00100000:1.0:1789596643.869923:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964774144 00000100:00100000:1.0:1789596643.869966:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964774272 00000100:00100000:1.0:1789596643.869970:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964774272 00000100:00100000:1.0:1789596643.870011:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789596643.870020:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964774144:12345-0@lo:400: 00000100:00100000:1.0:1789596643.870078:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964774144:12345-0@lo:400: Request processed in 60us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596643.870085:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789596643.870104:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789596643.870110:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964774272:12345-0@lo:400: 00000100:00100000:1.0:1789596643.870138:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964774272:12345-0@lo:400: Request processed in 28us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596643.870143:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789596643.870186:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964774272:0@lo:400: 00000100:00100000:1.0:1789596643.870196:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964774144:0@lo:400: 00000100:00100000:0.0:1789596643.870320:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964774400:0@lo:400: 00000100:00100000:0.0:1789596643.870378:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596643.870413:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789596643.870420:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964774016:0@lo:400: 00000100:00100000:0.0:1789596643.870447:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596643.870467:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964774528:0@lo:400: 00000100:00100000:0.0:1789596643.870490:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596643.870517:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964774400 00000100:00100000:0.0:1789596643.870521:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964774400 00000100:00100000:0.0:1789596643.870547:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789596643.870554:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876527964774400:12345-0@lo:400: 00000100:00100000:0.0:1789596643.870588:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876527964774400:12345-0@lo:400: Request processed in 35us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596643.870594:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1789596643.870754:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596643.870767:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964774528 00000100:00100000:0.0:1789596643.870771:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964774528 00000100:00100000:0.0:1789596643.870811:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789596643.870849:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964774528:12345-0@lo:400: 00000100:00100000:0.0:1789596643.870880:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964774528:12345-0@lo:400: Request processed in 32us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596643.870885:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789596643.870915:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8fa1c5500 x1876527964774528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596643.870927:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964774528:0@lo:400: 00000100:00100000:0.0:1789596643.870936:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964774400:0@lo:400: 00000100:00080000:1.0:1789596643.871007:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789596643.871096:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964774016 00000100:00100000:3.0:1789596643.871100:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964774016 00000100:00100000:3.0:1789596643.871133:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789596643.871145:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964774016:12345-0@lo:400: 00000100:00100000:3.0:1789596643.871180:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964774016:12345-0@lo:400: Request processed in 36us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596643.871185:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789596643.871214:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964774016:0@lo:400: 00010000:00010000:0.0:1789596644.124156:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596644.392513:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964774656:0@lo:13: 00000100:00100000:1.0:1789596644.392619:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596644.392756:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964774656 00000100:00100000:3.0:1789596644.392764:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964774656 00000100:00100000:3.0:1789596644.392833:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789596644.392842:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964774656:12345-0@lo:13: 00002000:00000024:3.0:1789596644.392877:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596644.392919:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964774656:12345-0@lo:13: Request processed in 79us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596644.392926:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789596644.393164:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8f6527800 x1876527964774656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596660 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596644.393184:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964774656:0@lo:13: 00010000:00010000:0.0:1789596645.148754:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596646.173062:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789596646.394793:0:8457:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc74049d20 20000000:00000080:2.0:1789596646.394809:0:8457:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ea8ef53e800 uarg=0000000000000000 20000000:01000000:2.0:1789596646.395811:0:8457:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789596646.395837:0:8457:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789596646.395839:0:8457:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789596646.395844:0:8457:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789596646.395848:0:8457:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789596646.395862:0:8457:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789596646.395864:0:8457:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789596646.396158:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789596646.396162:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789596646.398793:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1789596646.400997:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1789596646.401051:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1789596646.401320:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1789596646.401336:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789596646.401339:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789596646.402046:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1789596646.409326:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1789596646.409420:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1789596646.409460:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1789596646.409494:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789596646.409497:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789596646.410410:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789596646.410791:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789596646.410890:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1789596646.410927:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1789596646.410940:0:8457:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789596646.410942:0:8457:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789596646.415022:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1789596646.415486:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1789596646.415532:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1789596646.415577:0:8457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:2.0:1789596646.415603:0:8457:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789596646.415621:0:8457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ea8ef426a00/0x8973ae90b38d7948 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.415639:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8c0031600/0x8973ae90b38d7845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d783e expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.415648:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d786f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7868 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.415655:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8c0030a00/0x8973ae90b38d7899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7892 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.415662:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d78a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d78a0 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.415669:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d78b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d78ae expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.415676:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8d5f89e00/0x8973ae90b38d78d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d78ca expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.415682:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d78fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d78f4 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.415691:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8d5f88c00/0x8973ae90b38d7909 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c20 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.415705:0:8457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7910 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c27 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.415713:0:8457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ea8ef426a00/0x8973ae90b38d7948 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.415751:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c27 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.415767:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c27 expref: 9 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596646.415783:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876527964774784:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789596646.415904:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8d5f88c00/0x8973ae90b38d7909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c20 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.415913:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ea8d5f88c00/0x8973ae90b38d7909 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c20 expref: 9 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596646.415921:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900008a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876527964774912:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789596646.415951:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d78fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d78f4 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.415959:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d78fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d78f4 expref: 18 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596646.415968:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876527964775040:0@lo:104: 00000100:00100000:2.0:1789596646.416003:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789596646.416043:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8d5f89e00/0x8973ae90b38d78d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d78ca expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.416051:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea8d5f89e00/0x8973ae90b38d78d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d78ca expref: 18 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596646.416060:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876527964775168:0@lo:104: 00000100:00100000:2.0:1789596646.416079:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789596646.416096:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d78b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d78ae expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.416104:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d78b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d78ae expref: 18 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596646.416112:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876527964775296:0@lo:104: 00010000:00010000:2.0:1789596646.416129:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d78a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d78a0 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.416136:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d78a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d78a0 expref: 18 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596646.416143:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876527964775424:0@lo:104: 00010000:00010000:2.0:1789596646.416159:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8c0030a00/0x8973ae90b38d7899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d7892 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.416165:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea8c0030a00/0x8973ae90b38d7899 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d7892 expref: 18 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596646.416173:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876527964775552:0@lo:104: 00010000:00010000:2.0:1789596646.416202:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d786f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d7868 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.416212:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d786f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d7868 expref: 18 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596646.416220:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa661500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876527964775680:0@lo:104: 00010000:00010000:2.0:1789596646.416240:0:8457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8c0031600/0x8973ae90b38d7845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d783e expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.416247:0:8457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea8c0031600/0x8973ae90b38d7845 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d783e expref: 18 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596646.416255:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa660000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876527964775808:0@lo:104: 00000100:00100000:2.0:1789596646.416267:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b480 going to sleep for 11 seconds 00000100:00100000:0.0:1789596646.418564:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789596646.418618:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596646.418653:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596646.418662:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596646.418671:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596646.418680:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596646.418691:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964775040 00000100:00100000:0.0:1789596646.418701:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964775040 00000100:00100000:0.0:1789596646.418742:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964775168 00000100:00100000:0.0:1789596646.418745:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964775168 00000100:00100000:0.0:1789596646.418754:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964775296 00000100:00100000:0.0:1789596646.418756:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964775296 00000100:00100000:0.0:1789596646.418764:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964775424 00000100:00100000:0.0:1789596646.418766:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964775424 00000100:00100000:0.0:1789596646.418791:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964775552 00000100:00100000:0.0:1789596646.418793:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964775552 00000100:00100000:0.0:1789596646.418801:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964775680 00000100:00100000:0.0:1789596646.418803:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964775680 00000100:00100000:0.0:1789596646.418811:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964775808 00000100:00100000:0.0:1789596646.418813:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964775808 00000100:00100000:0.0:1789596646.418861:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789596646.418870:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900009500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+9:8457:x1876527964775040:12345-0@lo:104: 00010000:00010000:0.0:1789596646.418887:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031c00/0x8973ae90b38d78f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d78fb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.418956:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789596646.418962:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900009500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+9:8457:x1876527964775040:12345-0@lo:104: Request processed in 95us (2959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596646.418969:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789596646.418988:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789596646.418994:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff3e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+8:8457:x1876527964775168:12345-0@lo:104: 00010000:00010000:0.0:1789596646.419002:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d78ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d78d1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419033:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789596646.419039:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff3e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+8:8457:x1876527964775168:12345-0@lo:104: Request processed in 46us (2959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596646.419044:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789596646.419073:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789596646.419078:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff388700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+7:8457:x1876527964775296:12345-0@lo:104: 00010000:00010000:0.0:1789596646.419085:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d78ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d78b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419127:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789596646.419132:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff388700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+7:8457:x1876527964775296:12345-0@lo:104: Request processed in 54us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596646.419137:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789596646.419151:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789596646.419156:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff388e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+6:8457:x1876527964775424:12345-0@lo:104: 00010000:00010000:0.0:1789596646.419162:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9200/0x8973ae90b38d78a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d78a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419186:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789596646.419191:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff388e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+6:8457:x1876527964775424:12345-0@lo:104: Request processed in 36us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596646.419197:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789596646.419208:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789596646.419213:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff38b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+5:8457:x1876527964775552:12345-0@lo:104: 00010000:00010000:0.0:1789596646.419220:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483c00/0x8973ae90b38d7892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7899 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419243:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1789596646.419247:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff38b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+5:8457:x1876527964775552:12345-0@lo:104: Request processed in 34us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596646.419252:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789596646.419263:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789596646.419269:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff389f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+4:8457:x1876527964775680:12345-0@lo:104: 00010000:00010000:0.0:1789596646.419277:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89600/0x8973ae90b38d7868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d786f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419313:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1789596646.419318:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff389f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+4:8457:x1876527964775680:12345-0@lo:104: Request processed in 50us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596646.419323:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789596646.419334:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789596646.419339:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff38b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:8457:x1876527964775808:12345-0@lo:104: 00010000:00010000:0.0:1789596646.419345:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d783e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7845 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419368:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1789596646.419372:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff38b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:8457:x1876527964775808:12345-0@lo:104: Request processed in 34us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596646.419377:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1789596646.419395:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789596646.419401:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031c00/0x8973ae90b38d78f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d78fb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419408:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031c00 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:0.0:1789596646.419412:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031c00/0x8973ae90b38d78f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d78fb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419420:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031c00/0x8973ae90b38d78f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d78fb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596646.419428:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031c00/0x8973ae90b38d78f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d78fb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596646.419434:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789596646.419473:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031c00/0x8973ae90b38d78f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d78fb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419479:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789596646.419498:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031c00/0x8973ae90b38d78f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d78fb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419505:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031c00/0x8973ae90b38d78f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d78fb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419519:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789596646.419522:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d78ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d78d1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419527:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030200 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:0.0:1789596646.419530:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d78ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d78d1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419536:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d78ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d78d1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596646.419541:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d78ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d78d1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596646.419546:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789596646.419559:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d78ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d78d1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419565:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789596646.419580:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d78ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d78d1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419609:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d78ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d78d1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419622:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789596646.419625:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d78ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d78b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419631:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1482400 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:0.0:1789596646.419634:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d78ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d78b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419641:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d78ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d78b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596646.419647:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d78ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d78b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596646.419653:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789596646.419666:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d78ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d78b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419672:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789596646.419678:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d78ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d78b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419684:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482400/0x8973ae90b38d78ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d78b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419693:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789596646.419702:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9200/0x8973ae90b38d78a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d78a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419707:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f9200 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:0.0:1789596646.419710:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9200/0x8973ae90b38d78a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d78a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419716:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9200/0x8973ae90b38d78a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d78a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596646.419723:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9200/0x8973ae90b38d78a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d78a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596646.419728:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789596646.419742:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9200/0x8973ae90b38d78a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d78a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419748:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789596646.419756:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9200/0x8973ae90b38d78a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d78a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419762:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9200/0x8973ae90b38d78a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d78a7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419770:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789596646.419773:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483c00/0x8973ae90b38d7892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7899 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419778:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483c00 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:0.0:1789596646.419781:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483c00/0x8973ae90b38d7892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d7899 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419797:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483c00/0x8973ae90b38d7892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d7899 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596646.419803:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483c00/0x8973ae90b38d7892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d7899 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596646.419807:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789596646.419844:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483c00/0x8973ae90b38d7892 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7899 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419851:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789596646.419856:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483c00/0x8973ae90b38d7892 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7899 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419863:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483c00/0x8973ae90b38d7892 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7899 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419873:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789596646.419876:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89600/0x8973ae90b38d7868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d786f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419881:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89600 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:0.0:1789596646.419884:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89600/0x8973ae90b38d7868 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d786f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419890:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89600/0x8973ae90b38d7868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d786f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596646.419896:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89600/0x8973ae90b38d7868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d786f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596646.419908:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789596646.419920:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89600/0x8973ae90b38d7868 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d786f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419926:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789596646.419930:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89600/0x8973ae90b38d7868 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d786f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419937:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89600/0x8973ae90b38d7868 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d786f expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419945:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596646.419948:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d783e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7845 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419954:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483200 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:0.0:1789596646.419957:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d783e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d7845 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419963:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d783e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d7845 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596646.419969:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d783e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d7845 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596646.419973:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789596646.419983:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d783e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7845 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.419988:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789596646.419999:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d783e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7845 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.420006:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483200/0x8973ae90b38d783e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7845 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.420021:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596646.420023:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596646.420025:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596646.420034:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596646.420039:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596646.420060:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964775936:0@lo:103: 00000100:00100000:0.0:1789596646.420101:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596646.420137:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964776448:0@lo:103: 00000100:00100000:0.0:1789596646.420158:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596646.420179:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789596646.420184:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964776320:0@lo:103: 00000100:00100000:0.0:1789596646.420203:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596646.420230:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964776064:0@lo:103: 00000100:00100000:0.0:1789596646.420253:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596646.420269:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964776576:0@lo:103: 00000100:00100000:0.0:1789596646.420287:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596646.420298:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789596646.420302:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964776192:0@lo:103: 00000100:00100000:0.0:1789596646.420318:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596646.420327:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964776704:0@lo:103: 00000100:00100000:0.0:1789596646.420345:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596646.420382:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964775936 00000100:00100000:0.0:1789596646.420389:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964775936 00010000:00010000:0.0:1789596646.420411:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d78fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d78f4 expref: 19 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596646.420427:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964776448 00000100:00100000:0.0:1789596646.420429:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964776448 00010000:00010000:0.0:1789596646.420441:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8c0030a00/0x8973ae90b38d7899 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d7892 expref: 20 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596646.420451:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964776320 00000100:00100000:0.0:1789596646.420453:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964776320 00010000:00010000:0.0:1789596646.420462:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d78a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d78a0 expref: 21 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596646.420470:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964776064 00000100:00100000:0.0:1789596646.420473:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964776064 00010000:00010000:0.0:1789596646.420482:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8d5f89e00/0x8973ae90b38d78d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d78ca expref: 22 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596646.420490:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964776576 00000100:00100000:0.0:1789596646.420492:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964776576 00010000:00010000:0.0:1789596646.420504:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d786f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d7868 expref: 23 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596646.420515:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964776192 00000100:00100000:0.0:1789596646.420517:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964776192 00010000:00010000:0.0:1789596646.420527:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d78b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d78ae expref: 24 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596646.420536:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964776704 00000100:00100000:0.0:1789596646.420538:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964776704 00010000:00010000:0.0:1789596646.420548:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8c0031600/0x8973ae90b38d7845 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d783e expref: 25 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596646.420569:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789596646.420576:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff389500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+25:3307:x1876527964775936:12345-0@lo:103: 00010000:00010000:0.0:1789596646.420601:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596646.420607:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d78fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d78f4 expref: 25 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.420617:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d78fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d78f4 expref: 25 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.420634:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596646.420667:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff389500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+25:3307:x1876527964775936:12345-0@lo:103: Request processed in 91us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596646.420672:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789596646.420687:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789596646.420693:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff388000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+24:3307:x1876527964776448:12345-0@lo:103: 00010000:00010000:0.0:1789596646.420702:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596646.420706:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8c0030a00/0x8973ae90b38d7899 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d7892 expref: 24 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.420714:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8c0030a00/0x8973ae90b38d7899 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d7892 expref: 24 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.420722:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596646.420743:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff388000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+24:3307:x1876527964776448:12345-0@lo:103: Request processed in 51us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596646.420748:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789596646.420758:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789596646.420771:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff38b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+23:3307:x1876527964776320:12345-0@lo:103: 00010000:00010000:0.0:1789596646.420779:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596646.420783:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d78a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d78a0 expref: 23 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.420790:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d78a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d78a0 expref: 23 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.420798:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596646.420843:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff38b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+23:3307:x1876527964776320:12345-0@lo:103: Request processed in 74us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596646.420849:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789596646.420862:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789596646.420867:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff389180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+22:3308:x1876527964776064:12345-0@lo:103: 00010000:00010000:0.0:1789596646.420874:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596646.420877:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8d5f89e00/0x8973ae90b38d78d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d78ca expref: 22 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.420884:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8d5f89e00/0x8973ae90b38d78d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d78ca expref: 22 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.420893:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596646.420918:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff389180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+22:3308:x1876527964776064:12345-0@lo:103: Request processed in 51us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596646.420923:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789596646.420937:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789596646.420942:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+21:3308:x1876527964776576:12345-0@lo:103: 00010000:00010000:0.0:1789596646.420948:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596646.420958:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d786f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d7868 expref: 21 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.420966:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d786f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d7868 expref: 21 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.420975:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596646.420996:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+21:3308:x1876527964776576:12345-0@lo:103: Request processed in 54us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596646.421002:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789596646.421016:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789596646.421021:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa251880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+20:3308:x1876527964776192:12345-0@lo:103: 00010000:00010000:0.0:1789596646.421028:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596646.421032:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d78b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d78ae expref: 20 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.421039:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d78b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d78ae expref: 20 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.421048:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596646.421067:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa251880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+20:3308:x1876527964776192:12345-0@lo:103: Request processed in 47us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596646.421073:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789596646.421084:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789596646.421090:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c8282050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964776704:12345-0@lo:103: 00010000:00010000:0.0:1789596646.421098:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596646.421102:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8c0031600/0x8973ae90b38d7845 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d783e expref: 19 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.421119:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8c0031600/0x8973ae90b38d7845 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d783e expref: 19 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596646.421127:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596646.421151:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c8282050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964776704:12345-0@lo:103: Request processed in 61us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596646.421156:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789596646.421220:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964776192:0@lo:103: 00000100:00100000:0.0:1789596646.421228:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964776704:0@lo:103: 00000100:00100000:0.0:1789596646.421234:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964776064:0@lo:103: 00000100:00100000:0.0:1789596646.421240:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964776576:0@lo:103: 00000100:00100000:0.0:1789596646.421267:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964776320:0@lo:103: 00000100:00100000:0.0:1789596646.421274:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964775936:0@lo:103: 00000100:00100000:0.0:1789596646.421280:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964776448:0@lo:103: 00010000:00010000:2.0:1789596646.421399:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d78fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d78f4 expref: 18 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596646.421411:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876527964775040:0@lo:104: 00010000:00010000:2.0:1789596646.421421:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f89e00/0x8973ae90b38d78d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d78ca expref: 17 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596646.421427:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876527964775168:0@lo:104: 00010000:00010000:2.0:1789596646.421435:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d78b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d78ae expref: 16 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596646.421445:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876527964775296:0@lo:104: 00010000:00010000:2.0:1789596646.421453:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d78a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d78a0 expref: 15 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596646.421460:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea90000a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876527964775424:0@lo:104: 00010000:00010000:2.0:1789596646.421479:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8c0030a00/0x8973ae90b38d7899 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d7892 expref: 14 pid: 5835 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596646.421488:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876527964775552:0@lo:104: 00010000:00010000:2.0:1789596646.421497:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d786f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d7868 expref: 13 pid: 5836 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596646.421505:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa661500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876527964775680:0@lo:104: 00010000:00010000:2.0:1789596646.421513:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8c0031600/0x8973ae90b38d7845 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d783e expref: 12 pid: 5834 timeout: 381 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596646.421522:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa660000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876527964775808:0@lo:104: 00000100:00100000:0.0:1789596646.424840:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596646.424917:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596646.426009:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876527964774784:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789596646.426027:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900008a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8457:1876527964774912:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789596646.426089:0:8457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ea8ef426a00/0x8973ae90b38d7948 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596646.431377:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944831104 00000100:00100000:1.0:1789596646.431392:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944831104 00010000:00010000:1.0:1789596646.431442:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c27 expref: 10 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596646.431482:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944831232 00000100:00100000:1.0:1789596646.431486:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944831232 00010000:00010000:1.0:1789596646.431499:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8d5f88c00/0x8973ae90b38d7909 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c20 expref: 11 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596646.431537:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 19 00000100:00100000:1.0:1789596646.431546:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+11:2354:x1876527944831104:12345-192.168.202.44@tcp:103: 00010000:00010000:1.0:1789596646.431561:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596646.431567:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7910 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c27 expref: 11 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596646.431579:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7910 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c27 expref: 11 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596646.431607:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7910 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c27 expref: 11 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596646.431623:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596646.431676:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa253480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2354:x1876527944831104:12345-192.168.202.44@tcp:103: Request processed in 130us (6871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596646.431683:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 19 00000100:00100000:1.0:1789596646.431702:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 20 00000100:00100000:1.0:1789596646.431708:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa251880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+9:2354:x1876527944831232:12345-192.168.202.44@tcp:103: 00010000:00010000:1.0:1789596646.431715:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596646.431720:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8d5f88c00/0x8973ae90b38d7909 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c20 expref: 9 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596646.431730:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8d5f88c00/0x8973ae90b38d7909 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c20 expref: 9 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596646.431740:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f88c00/0x8973ae90b38d7909 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c20 expref: 9 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596646.431758:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ea8ef426a00/0x8973ae90b38d7948 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596646.431766:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ef426a00/0x8973ae90b38d7948 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596646.431782:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8ef426a00/0x8973ae90b38d7948 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596646.431789:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8ef426a00/0x8973ae90b38d7948 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596646.431795:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ea8ef426a00/0x8973ae90b38d7948 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596646.431802:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ea8ef426a00/0x8973ae90b38d7948 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596646.431808:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426a00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:1.0:1789596646.431835:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ea8ef426a00/0x8973ae90b38d7948 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596646.431846:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ea8ef426a00/0x8973ae90b38d7948 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596646.431862:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ea8ef426a00/0x8973ae90b38d7948 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596646.431873:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596646.431893:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa251880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+8:2354:x1876527944831232:12345-192.168.202.44@tcp:103: Request processed in 184us (6976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596646.431905:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 20 00010000:00010000:2.0:1789596646.432246:0:8457:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ea8ef426a00/0x8973ae90b38d7948 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.432256:0:8457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ea8ef426a00/0x8973ae90b38d7948 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596646.432263:0:8457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8ef426a00/0x8973ae90b38d7948 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596647.195419:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789596647.642934:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789596647.642943:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ea8f66d1800 from 39 10000000:01000000:0.0:1789596647.642950:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789596647.642997:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d794f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596647.643009:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d794f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596647.643036:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d794f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596647.643060:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa250700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964776832:0@lo:101: 00000100:00100000:0.0:1789596647.643126:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596647.643249:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c9100d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789596647.644723:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964776832 00000100:00100000:2.0:1789596647.644738:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964776832 00000100:00100000:3.0:1789596647.644975:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789596647.644986:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+12:5838:x1876527964776832:12345-0@lo:101: 00010000:00010000:3.0:1789596647.645001:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596647.645022:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f88a00/0x8973ae90b38d7956 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d794f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596647.645046:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f88a00/0x8973ae90b38d7956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d794f expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596647.645075:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f88a00/0x8973ae90b38d7956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d794f expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596647.645085:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88a00, rc 0) 00000100:00100000:3.0:1789596647.645162:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:5838:x1876527964776832:12345-0@lo:101: Request processed in 178us (2036us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596647.645169:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789596647.645256:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa250700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964776832:0@lo:101: 00010000:00010000:1.0:1789596647.645272:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d794f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7956 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596647.645282:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d794f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7956 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596647.645357:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964776960:0@lo:501: 00000100:00100000:1.0:1789596647.645405:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596647.646012:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789596647.652979:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964776960 00000100:00100000:0.0:1789596647.652994:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964776960 00000100:00100000:0.0:1789596647.653058:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789596647.653067:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:5838:x1876527964776960:12345-0@lo:501: 00000100:00100000:0.0:1789596647.653456:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:5838:x1876527964776960:12345-0@lo:501: Request processed in 388us (8048us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596647.653464:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789596647.654479:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964776960:0@lo:501: 00000100:00100000:1.0:1789596647.654538:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964777088:0@lo:503: 00000100:00100000:1.0:1789596647.654628:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596647.654668:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789596647.654857:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964777088 00000100:00100000:0.0:1789596647.654865:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964777088 00000100:00100000:0.0:1789596647.654912:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789596647.654921:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:5838:x1876527964777088:12345-0@lo:503: 00000100:00100000:0.0:1789596647.655112:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:5838:x1876527964777088:12345-0@lo:503: Request processed in 192us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596647.655120:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789596647.655257:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964777088:0@lo:503: 00000100:00100000:1.0:1789596647.658218:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8476:1876527964777216:0@lo:502: 00000100:00100000:1.0:1789596647.658296:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596647.658552:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652e180 going to sleep for 11 seconds 00000100:00100000:2.0:1789596647.661079:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964777216 00000100:00100000:2.0:1789596647.661111:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964777216 00000100:00100000:0.0:1789596647.661729:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789596647.661805:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:8476:x1876527964777216:12345-0@lo:502: 00000100:00100000:1.0:1789596647.662137:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:8476:x1876527964777216:12345-0@lo:502: Request processed in 398us (3840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596647.662144:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789596647.662269:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8476:1876527964777216:0@lo:502: 00000100:00100000:0.0:1789596647.662342:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa250e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8476:1876527964777344:0@lo:502: 00000100:00100000:0.0:1789596647.662583:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596647.662621:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c9100b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596647.662740:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964777344 00000100:00100000:2.0:1789596647.662747:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964777344 00000100:00100000:2.0:1789596647.662785:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789596647.662792:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:8476:x1876527964777344:12345-0@lo:502: 00000100:00100000:2.0:1789596647.662968:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:8476:x1876527964777344:12345-0@lo:502: Request processed in 176us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596647.662975:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789596647.663109:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa250e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8476:1876527964777344:0@lo:502: 00000040:00080000:0.0:1789596647.663133:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789596647.664119:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789596647.664150:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789596647.664160:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d794f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7956 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596647.664169:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d794f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7956 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596647.664179:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789596647.664182:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1789596647.664184:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789596647.664214:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8200/0x8973ae90b38d795d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596647.664222:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8200/0x8973ae90b38d795d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596647.664232:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8200/0x8973ae90b38d795d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596647.664249:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964777472:0@lo:101: 00000100:00100000:1.0:1789596647.664289:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596647.664519:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652e000 going to sleep for 11 seconds 00000100:00100000:3.0:1789596647.664561:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964777472 00000100:00100000:3.0:1789596647.664567:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964777472 00000100:00100000:3.0:1789596647.664720:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789596647.664731:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+13:5838:x1876527964777472:12345-0@lo:101: 00010000:00010000:3.0:1789596647.664742:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596647.664756:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f89a00/0x8973ae90b38d7964 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d795d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596647.664779:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f89a00/0x8973ae90b38d7964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d795d expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596647.664791:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f89a00/0x8973ae90b38d7964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d795d expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596647.664800:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89a00, rc 0) 00000100:00100000:3.0:1789596647.666861:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:5838:x1876527964777472:12345-0@lo:101: Request processed in 2123us (2561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596647.666875:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789596647.674755:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964777472:0@lo:101: 00010000:00010000:0.0:1789596647.674788:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8200/0x8973ae90b38d795d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7964 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596647.674801:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8200/0x8973ae90b38d795d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7964 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596647.674914:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa250e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964777600:0@lo:501: 00000100:00100000:0.0:1789596647.674974:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596647.675010:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c9100b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596647.675225:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964777600 00000100:00100000:2.0:1789596647.675232:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964777600 00000100:00100000:2.0:1789596647.675286:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789596647.675296:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:5838:x1876527964777600:12345-0@lo:501: 00000100:00100000:2.0:1789596647.675602:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:5838:x1876527964777600:12345-0@lo:501: Request processed in 306us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596647.675610:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789596647.676032:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa250e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964777600:0@lo:501: 00000100:00100000:0.0:1789596647.676070:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa250e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964777728:0@lo:503: 00000100:00100000:0.0:1789596647.676111:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596647.676143:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c9100b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596647.676205:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964777728 00000100:00100000:3.0:1789596647.676210:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964777728 00000100:00100000:3.0:1789596647.676246:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789596647.676261:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:5838:x1876527964777728:12345-0@lo:503: 00000100:00100000:3.0:1789596647.676609:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:5838:x1876527964777728:12345-0@lo:503: Request processed in 347us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596647.676616:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789596647.676769:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa250e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964777728:0@lo:503: 00000100:00100000:2.0:1789596647.684214:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa660000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8477:1876527964777856:0@lo:502: 00000100:00100000:2.0:1789596647.684329:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596647.684380:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789596647.684613:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964777856 00000100:00100000:1.0:1789596647.684621:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964777856 00000100:00100000:1.0:1789596647.684681:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789596647.684691:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:8477:x1876527964777856:12345-0@lo:502: 00000100:00100000:1.0:1789596647.684990:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:8477:x1876527964777856:12345-0@lo:502: Request processed in 300us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596647.684998:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789596647.685179:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa660000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8477:1876527964777856:0@lo:502: 00000020:01000000:2.0:1789596647.685208:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596647.685217:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596647.685220:0:8477:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789596647.685225:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789596647.685251:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa660000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8477:1876527964777984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596647.685287:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596647.685329:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596647.685706:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964777984 00000100:00100000:0.0:1789596647.685713:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964777984 00000100:00100000:0.0:1789596647.685753:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789596647.685761:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:8477:x1876527964777984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596647.685932:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:8477:x1876527964777984:12345-0@lo:502:llog_process_th.0 Request processed in 172us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596647.685939:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789596647.685978:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa660000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8477:1876527964777984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789596647.686004:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596647.686009:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596647.686011:0:8477:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789596647.686016:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1789596647.686339:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789596647.686366:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789596647.686506:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8200/0x8973ae90b38d795d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7964 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596647.686517:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8200/0x8973ae90b38d795d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7964 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596647.686525:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789596647.686527:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ea8f9e94000 from 39 10000000:01000000:1.0:1789596647.686530:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789596647.686558:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9c00/0x8973ae90b38d796b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596647.686567:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9c00/0x8973ae90b38d796b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596647.686586:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9c00/0x8973ae90b38d796b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596647.686604:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964778112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789596647.686638:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596647.686727:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596647.686879:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964778112 00000100:00100000:0.0:1789596647.686884:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964778112 00000100:00100000:0.0:1789596647.686920:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789596647.686927:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:5838:x1876527964778112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596647.686936:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596647.686950:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8c0031c00/0x8973ae90b38d7972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d796b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596647.686969:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c0031c00/0x8973ae90b38d7972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d796b expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596647.686979:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8c0031c00/0x8973ae90b38d7972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d796b expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596647.686986:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0031c00, rc 0) 00000100:00100000:0.0:1789596647.687016:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:5838:x1876527964778112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596647.687022:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789596647.687144:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964778112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596647.687157:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9c00/0x8973ae90b38d796b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7972 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596647.687165:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9c00/0x8973ae90b38d796b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7972 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596647.687215:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964778240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596647.687247:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596647.687325:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596647.696791:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964778240 00000100:00100000:3.0:1789596647.696806:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964778240 00000100:00100000:2.0:1789596647.700926:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789596647.700942:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:5838:x1876527964778240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596647.701278:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:5838:x1876527964778240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 339us (14028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596647.701286:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789596647.701405:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964778240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596647.701460:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964778368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596647.701507:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596647.704391:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596647.710324:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964778368 00000100:00100000:0.0:1789596647.710339:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964778368 00000100:00100000:0.0:1789596647.710680:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789596647.710692:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:5838:x1876527964778368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596647.711059:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:5838:x1876527964778368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 369us (9551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596647.711077:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789596647.711196:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964778368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596647.715886:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8478:1876527964778496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596647.715969:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596647.716009:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596647.716090:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964778496 00000100:00100000:0.0:1789596647.716099:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964778496 00000100:00100000:0.0:1789596647.716142:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789596647.716150:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:8478:x1876527964778496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596647.716431:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:8478:x1876527964778496:12345-0@lo:502:llog_process_th.0 Request processed in 280us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596647.716439:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789596647.716672:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8478:1876527964778496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596647.716723:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6525180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8478:1876527964778624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596647.716761:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596647.716792:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c5ba3900 going to sleep for 11 seconds 00000100:00100000:0.0:1789596647.716995:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964778624 00000100:00100000:0.0:1789596647.717000:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964778624 00000100:00100000:0.0:1789596647.717024:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789596647.717032:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:8478:x1876527964778624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596647.717185:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:8478:x1876527964778624:12345-0@lo:502:llog_process_th.0 Request processed in 152us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596647.717192:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789596647.717231:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6525180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8478:1876527964778624:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789596647.717252:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789596647.717505:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789596647.717525:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789596647.717535:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9c00/0x8973ae90b38d796b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7972 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596647.717545:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9c00/0x8973ae90b38d796b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7972 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596647.717556:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789596647.717559:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1789596647.717562:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789596647.717598:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d7979 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596647.717606:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d7979 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596647.717615:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d7979 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596647.717638:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964778752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789596647.717677:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596647.717701:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c5ba3900 going to sleep for 11 seconds 00000100:00100000:3.0:1789596647.717715:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964778752 00000100:00100000:3.0:1789596647.717719:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964778752 00000100:00100000:3.0:1789596647.717740:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789596647.717745:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:5838:x1876527964778752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596647.717754:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596647.717764:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f88000/0x8973ae90b38d7980 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d7979 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596647.717784:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f88000/0x8973ae90b38d7980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d7979 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596647.717795:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f88000/0x8973ae90b38d7980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7979 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596647.717804:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88000, rc 0) 00000100:00100000:3.0:1789596647.717853:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:5838:x1876527964778752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596647.717859:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789596647.717888:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964778752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596647.717899:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d7979 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7980 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596647.717908:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d7979 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7980 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596647.717956:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964778880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596647.717984:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596647.717999:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c5ba3900 going to sleep for 11 seconds 00000100:00100000:3.0:1789596647.718010:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964778880 00000100:00100000:3.0:1789596647.718013:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964778880 00000100:00100000:3.0:1789596647.718030:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789596647.718035:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:5838:x1876527964778880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596647.718236:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:5838:x1876527964778880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596647.718243:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789596647.718270:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964778880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596647.718295:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964779008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789596647.718328:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596647.718340:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c5ba3900 going to sleep for 11 seconds 00000100:00100000:3.0:1789596647.718351:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964779008 00000100:00100000:3.0:1789596647.718354:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964779008 00000100:00100000:0.0:1789596647.719544:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789596647.719562:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:5838:x1876527964779008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596647.719860:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:5838:x1876527964779008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 306us (1530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596647.719867:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789596647.719916:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6524a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964779008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596647.720137:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa250e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8479:1876527964779136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596647.720180:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596647.720202:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964779136 00000100:00100000:0.0:1789596647.720207:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964779136 00000100:00100000:0.0:1789596647.720230:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789596647.720236:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:8479:x1876527964779136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596647.720363:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:8479:x1876527964779136:12345-0@lo:502:llog_process_th.0 Request processed in 126us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596647.721591:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c9100a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789596647.721621:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa250e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8479:1876527964779136:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789596647.721670:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596647.721682:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596647.721685:0:8479:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789596647.721690:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789596647.721724:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8479:1876527964779264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596647.721778:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596647.721811:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596647.721953:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964779264 00000100:00100000:3.0:1789596647.721960:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964779264 00000100:00100000:3.0:1789596647.722006:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789596647.722014:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:8479:x1876527964779264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596647.722275:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:8479:x1876527964779264:12345-0@lo:502:llog_process_th.0 Request processed in 261us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596647.722283:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789596647.722483:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789596647.727754:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8479:1876527964779264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789596647.727804:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596647.727913:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596647.727917:0:8479:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789596647.727923:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1789596647.731242:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789596647.731282:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789596647.731295:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d7979 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7980 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596647.731712:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d7979 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7980 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596647.731803:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789596647.731807:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ea8e4942800 from 39 10000000:01000000:2.0:1789596647.731810:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789596647.731875:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d7987 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596647.731885:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d7987 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596647.731895:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d7987 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596647.731923:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964779392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789596647.731995:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596647.732043:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596647.732114:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964779392 00000100:00100000:3.0:1789596647.732136:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964779392 00000100:00100000:3.0:1789596647.732183:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789596647.732192:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:5838:x1876527964779392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596647.732205:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596647.732216:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f89000/0x8973ae90b38d798e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d7987 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596647.732239:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f89000/0x8973ae90b38d798e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d7987 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596647.732250:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f89000/0x8973ae90b38d798e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7987 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596647.732259:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89000, rc 0) 00000100:00100000:3.0:1789596647.732558:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964779392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596647.732568:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789596647.732777:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964779392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596647.732791:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d7987 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d798e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596647.732800:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d7987 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d798e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596647.732889:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964779520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596647.732915:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596647.732991:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789596647.737024:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964779520 00000100:00100000:1.0:1789596647.737043:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964779520 00000100:00100000:1.0:1789596647.737104:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789596647.737115:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964779520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596647.737995:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964779520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 877us (5074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596647.738017:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789596647.738123:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964779520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596647.738172:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964779648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596647.738217:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596647.738253:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596647.738293:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964779648 00000100:00100000:0.0:1789596647.738299:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964779648 00000100:00100000:0.0:1789596647.738346:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789596647.738353:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964779648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596647.738523:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964779648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596647.738530:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789596647.738911:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964779648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596647.739223:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa661500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8480:1876527964779776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596647.739266:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596647.739288:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789596647.739512:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964779776 00000100:00100000:1.0:1789596647.739517:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964779776 00000100:00100000:1.0:1789596647.739553:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789596647.739561:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:8480:x1876527964779776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596647.740009:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:8480:x1876527964779776:12345-0@lo:502:llog_process_th.0 Request processed in 446us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596647.740017:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789596647.740110:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa661500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8480:1876527964779776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596647.740154:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa661500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8480:1876527964779904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596647.740187:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596647.740217:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789596647.740257:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964779904 00000100:00100000:0.0:1789596647.740263:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964779904 00000100:00100000:0.0:1789596647.740297:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789596647.740303:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:8480:x1876527964779904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596647.740700:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:8480:x1876527964779904:12345-0@lo:502:llog_process_th.0 Request processed in 395us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596647.740707:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789596647.740862:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa661500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8480:1876527964779904:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789596647.740883:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789596647.741168:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789596647.741184:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789596647.741194:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d7987 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d798e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596647.741204:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d7987 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d798e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596647.741215:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789596647.741218:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789596647.741221:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789596647.741247:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030600/0x8973ae90b38d7995 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596647.741256:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030600/0x8973ae90b38d7995 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596647.741265:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030600/0x8973ae90b38d7995 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596647.741279:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa251c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964780032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789596647.741543:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596647.745090:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c9100c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596647.745126:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964780032 00000100:00100000:1.0:1789596647.745137:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964780032 00000100:00100000:1.0:1789596647.745212:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789596647.745222:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964780032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596647.745239:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596647.745259:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea9021f9000/0x8973ae90b38d799c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d7995 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596647.745288:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea9021f9000/0x8973ae90b38d799c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d7995 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596647.745298:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea9021f9000/0x8973ae90b38d799c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7995 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596647.745321:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea9021f9000, rc 0) 00000100:00100000:1.0:1789596647.745416:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964780032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (3872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596647.745423:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789596647.745531:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa251c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964780032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596647.745548:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030600/0x8973ae90b38d7995 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d799c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596647.745559:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030600/0x8973ae90b38d7995 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d799c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596647.745658:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964780160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596647.745691:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596647.745716:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789596647.746015:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964780160 00000100:00100000:1.0:1789596647.746020:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964780160 00000100:00100000:1.0:1789596647.746051:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789596647.746059:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964780160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596647.746319:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964780160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596647.746326:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789596647.746358:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa661500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964780160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596647.746528:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964780288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596647.746569:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596647.746606:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596647.746617:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964780288 00000100:00100000:1.0:1789596647.746621:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964780288 00000100:00100000:1.0:1789596647.746640:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789596647.746720:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964780288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596647.746901:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964780288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596647.746908:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789596647.746951:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964780288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596647.747669:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8481:1876527964780416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596647.747718:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596647.747787:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596647.748938:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964780416 00000100:00100000:2.0:1789596647.748950:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964780416 00000100:00100000:2.0:1789596647.749036:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789596647.749047:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:8481:x1876527964780416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596647.749326:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:8481:x1876527964780416:12345-0@lo:502:llog_process_th.0 Request processed in 281us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596647.749334:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789596647.752915:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8481:1876527964780416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789596647.752966:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596647.752989:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596647.752991:0:8481:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789596647.752998:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789596647.753039:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8481:1876527964780544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596647.753108:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596647.759288:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596647.766295:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964780544 00000100:00100000:0.0:1789596647.766727:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964780544 00000100:00100000:0.0:1789596647.766786:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789596647.766796:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:8481:x1876527964780544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596647.767117:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:8481:x1876527964780544:12345-0@lo:502:llog_process_th.0 Request processed in 321us (14007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596647.767125:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789596647.767245:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8481:1876527964780544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789596647.767279:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596647.767286:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596647.767289:0:8481:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789596647.767294:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789596647.769516:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1789596647.769556:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789596647.769567:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030600/0x8973ae90b38d7995 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d799c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596647.769590:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030600/0x8973ae90b38d7995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d799c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596647.769602:0:5838:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789596647.769605:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ea8c2ca3380 from 1 10000000:01000000:0.0:1789596647.769608:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789596647.769878:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031200/0x8973ae90b38d79a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596647.769888:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031200/0x8973ae90b38d79a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596647.769898:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031200/0x8973ae90b38d79a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596647.771536:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa251c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964780672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789596647.771623:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596647.771678:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596647.772094:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964780672 00000100:00100000:0.0:1789596647.772102:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964780672 00000100:00100000:0.0:1789596647.772144:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789596647.772153:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964780672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596647.772167:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596647.772183:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8c0030000/0x8973ae90b38d79aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d79a3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596647.772224:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c0030000/0x8973ae90b38d79aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d79a3 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596647.772235:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8c0030000/0x8973ae90b38d79aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d79a3 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596647.772244:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030000, rc 0) 00000100:00100000:0.0:1789596647.772290:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964780672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596647.772296:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789596647.772361:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa251c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964780672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596647.772496:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031200/0x8973ae90b38d79a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d79aa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596647.772507:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031200/0x8973ae90b38d79a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d79aa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596647.772569:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa251c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964780800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596647.772609:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596647.772630:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c9100f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789596647.772719:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964780800 00000100:00100000:0.0:1789596647.772724:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964780800 00000100:00100000:0.0:1789596647.772745:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789596647.772751:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964780800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596647.773005:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964780800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (394us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789596647.773021:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789596647.773054:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa251c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964780800:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789596647.773077:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789596647.773084:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031200/0x8973ae90b38d79a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d79aa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596647.773092:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031200/0x8973ae90b38d79a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d79aa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596648.219125:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596648.478010:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789596648.478034:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964780928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596648.478103:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596648.478278:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964780928 00000100:00100000:3.0:1789596648.478287:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964780928 00000100:00100000:3.0:1789596648.478359:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789596648.478369:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964780928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596648.478407:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596648.478463:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964780928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596648.478469:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789596648.478664:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8fa1c5180 x1876527964780928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596648.478682:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964780928:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789596648.478741:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596648.806125:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596648.806160:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596648.806196:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596648.806231:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596648.806284:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944831488 00000100:00100000:0.0:1789596648.806294:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944831488 00000100:00100000:0.0:1789596648.806346:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 24 00000100:00100000:0.0:1789596648.806353:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2353:x1876527944831488:12345-192.168.202.44@tcp:400: 00000100:00100000:0.0:1789596648.806411:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2353:x1876527944831488:12345-192.168.202.44@tcp:400: Request processed in 59us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596648.806415:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 24 00000100:00100000:0.0:1789596648.806433:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944831744 00000100:00100000:0.0:1789596648.806435:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944831744 00000100:00100000:0.0:1789596648.806450:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944831616 00000100:00100000:0.0:1789596648.806451:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944831616 00000100:00100000:0.0:1789596648.806460:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 7 00000100:00100000:0.0:1789596648.806464:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2353:x1876527944831744:12345-192.168.202.44@tcp:400: 00000100:00100000:0.0:1789596648.806494:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2353:x1876527944831744:12345-192.168.202.44@tcp:400: Request processed in 30us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596648.806498:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 7 00000100:00100000:0.0:1789596648.806506:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 8 00000100:00100000:0.0:1789596648.806510:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2353:x1876527944831616:12345-192.168.202.44@tcp:400: 00000100:00100000:0.0:1789596648.806522:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2353:x1876527944831616:12345-192.168.202.44@tcp:400: Request processed in 12us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596648.806525:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 8 00000100:00100000:2.0:1789596648.807060:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944831360 00000100:00100000:2.0:1789596648.807066:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944831360 00000100:00100000:2.0:1789596648.807102:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 162 00000100:00100000:2.0:1789596648.807109:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+8:2353:x1876527944831360:12345-192.168.202.44@tcp:400: 00000100:00100000:2.0:1789596648.807139:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+8:2353:x1876527944831360:12345-192.168.202.44@tcp:400: Request processed in 31us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596648.807146:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 162 00000100:00080000:1.0:1789596648.807263:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789596648.807267:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789596648.807270:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596648.987996:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964781056:0@lo:400:kworker.0 00000100:00100000:0.0:1789596648.988079:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596648.988309:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964781056 00000100:00100000:2.0:1789596648.988319:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964781056 00000100:00100000:2.0:1789596648.988379:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789596648.988389:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3307:x1876527964781056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596648.988930:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964781440:0@lo:400:kworker.0 00000100:00100000:1.0:1789596648.988968:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596648.989011:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964781440 00000100:00100000:1.0:1789596648.989015:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964781440 00000100:00100000:1.0:1789596648.989054:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789596648.989061:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964781440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596648.989130:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964781440:12345-0@lo:400:kworker.0 Request processed in 70us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596648.989137:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789596648.989169:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596648.989200:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964781440:0@lo:400:kworker.0 00000100:00100000:1.0:1789596648.989231:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964781184:0@lo:400:kworker.0 00000100:00100000:1.0:1789596648.989254:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596648.989271:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596648.989277:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964781312:0@lo:400:kworker.0 00000100:00100000:1.0:1789596648.989298:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596648.989319:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964781184 00000100:00100000:1.0:1789596648.989323:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964781184 00000100:00100000:1.0:1789596648.989337:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964781312 00000100:00100000:1.0:1789596648.989340:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964781312 00000100:00100000:1.0:1789596648.989358:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789596648.989363:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964781184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596648.989393:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964781184:12345-0@lo:400:kworker.0 Request processed in 30us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596648.989399:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789596648.989410:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789596648.989415:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964781312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596648.989439:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964781312:12345-0@lo:400:kworker.0 Request processed in 24us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596648.989444:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789596648.989457:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596648.989472:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964781312:0@lo:400:kworker.0 00000100:00100000:1.0:1789596648.989490:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964781184:0@lo:400:kworker.0 00000100:00100000:2.0:1789596648.990233:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3307:x1876527964781056:12345-0@lo:400:kworker.0 Request processed in 1841us (2149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596648.990251:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789596648.990465:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596648.990475:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964781568:0@lo:400:kworker.0 00000100:00100000:1.0:1789596648.990520:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596648.990658:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964781568 00000100:00100000:2.0:1789596648.990664:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964781568 00000100:00080000:1.0:1789596648.990760:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596648.990912:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789596648.990920:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964781568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596648.990961:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964781568:12345-0@lo:400:kworker.0 Request processed in 43us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596648.990967:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789596648.991026:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8f6525f80 x1876527964781568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596648.991039:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964781568:0@lo:400:kworker.0 00000100:00100000:0.0:1789596648.991109:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964781056:0@lo:400:kworker.0 00010000:00010000:0.0:1789596649.243812:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596649.499465:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964781696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596649.499539:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596649.499835:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964781696 00000100:00100000:3.0:1789596649.499843:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964781696 00000100:00100000:3.0:1789596649.499902:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789596649.499912:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964781696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789596649.499957:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596649.500011:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964781696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596649.500021:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789596649.500165:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8f6527100 x1876527964781696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596665 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596649.500184:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964781696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596650.021911:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596650.022017:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944831872 00000100:00100000:2.0:1789596650.022028:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944831872 00000100:00100000:2.0:1789596650.022097:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 164 00000100:00100000:2.0:1789596650.022108:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+8:5592:x1876527944831872:12345-192.168.202.44@tcp:101: 00010000:00010000:2.0:1789596650.022127:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596650.022146:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8ef427400/0x8973ae90b38d79b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344c89 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596650.022173:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ef427400/0x8973ae90b38d79b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c89 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596650.022185:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8ef427400/0x8973ae90b38d79b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c89 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596650.022195:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427400, rc 0) 00000100:00100000:2.0:1789596650.022265:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+9:5592:x1876527944831872:12345-192.168.202.44@tcp:101: Request processed in 158us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596650.022272:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 164 00000100:00100000:1.0:1789596650.027576:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596650.027706:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944832000 00000100:00100000:3.0:1789596650.027715:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944832000 00000100:00100000:3.0:1789596650.027771:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 165 00000100:00100000:3.0:1789596650.027780:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+9:5592:x1876527944832000:12345-192.168.202.44@tcp:501: 00000100:00100000:3.0:1789596650.028448:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+9:5592:x1876527944832000:12345-192.168.202.44@tcp:501: Request processed in 666us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596650.028457:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 165 00000100:00100000:0.0:1789596650.030727:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596650.030865:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944832128 00000100:00100000:2.0:1789596650.030889:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944832128 00000100:00100000:2.0:1789596650.030947:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 166 00000100:00100000:2.0:1789596650.030957:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+9:5592:x1876527944832128:12345-192.168.202.44@tcp:503: 00000100:00100000:2.0:1789596650.031202:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+9:5592:x1876527944832128:12345-192.168.202.44@tcp:503: Request processed in 245us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596650.031211:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 166 00000100:00100000:1.0:1789596650.039979:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596650.040083:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944832256 00000100:00100000:2.0:1789596650.040096:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944832256 00000100:00100000:2.0:1789596650.040157:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 167 00000100:00100000:2.0:1789596650.040166:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+9:6077:x1876527944832256:12345-192.168.202.44@tcp:502: 00000100:00100000:2.0:1789596650.040467:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+9:6077:x1876527944832256:12345-192.168.202.44@tcp:502: Request processed in 300us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596650.040475:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 167 00000100:00100000:1.0:1789596650.055234:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596650.055450:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944832384 00000100:00100000:3.0:1789596650.055460:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944832384 00000100:00100000:3.0:1789596650.055522:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 168 00000100:00100000:3.0:1789596650.055532:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+9:6077:x1876527944832384:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789596650.055859:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+9:6077:x1876527944832384:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 282us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596650.055867:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 168 00000100:00100000:3.0:1789596650.060171:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596650.060324:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944832512 00000100:00100000:0.0:1789596650.060336:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944832512 00000100:00100000:0.0:1789596650.060397:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 169 00000100:00100000:0.0:1789596650.060407:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+9:5592:x1876527944832512:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596650.060423:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596650.060440:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8c0030a00/0x8973ae90b38d79b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344c90 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596650.060467:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c0030a00/0x8973ae90b38d79b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c90 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596650.060479:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8c0030a00/0x8973ae90b38d79b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c90 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596650.060502:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030a00, rc 0) 00000100:00100000:0.0:1789596650.060573:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:5592:x1876527944832512:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 167us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596650.060581:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 169 00000100:00100000:1.0:1789596650.074940:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596650.075118:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944832640 00000100:00100000:2.0:1789596650.075128:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944832640 00000100:00100000:2.0:1789596650.075175:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 170 00000100:00100000:2.0:1789596650.075184:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:5592:x1876527944832640:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596650.075476:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:5592:x1876527944832640:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 292us (546us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789596650.075485:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 170 00010000:00010000:1.0:1789596650.267297:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596651.292083:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789596651.709105:0:8518:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8d3dbf00 20000000:00000080:0.0:1789596651.709124:0:8518:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ea8c6ece800 uarg=0000000000000000 20000000:01000000:0.0:1789596651.709160:0:8518:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789596651.709166:0:8518:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789596651.709170:0:8518:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789596651.710810:0:8519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1789596651.711145:0:8518:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1789596651.715194:0:8518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1789596651.715241:0:8518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1789596651.715300:0:8518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1789596651.715316:0:8518:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789596651.715335:0:8518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d79bf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596651.715363:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea9021f8400/0x8973ae90b38d7734 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d772d expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596651.715371:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea902044200/0x8973ae90b38d7796 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d778f expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596651.715378:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7861 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d785a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596651.715387:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d791e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c58 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596651.715404:0:8518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d79bf lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596651.715442:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d791e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c58 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596651.715525:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d791e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c58 expref: 9 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596651.715553:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6524380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876527964781824:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789596651.715968:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7861 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d785a expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596651.715978:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7861 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d785a expref: 18 pid: 5834 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596651.715989:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6526d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876527964781952:0@lo:104: 00000100:00100000:3.0:1789596651.716032:0:8518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789596651.716069:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea902044200/0x8973ae90b38d7796 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d778f expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596651.716077:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea902044200/0x8973ae90b38d7796 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d778f expref: 18 pid: 5836 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596651.716085:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6526680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876527964782080:0@lo:104: 00000100:00100000:3.0:1789596651.716108:0:8518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789596651.716130:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea9021f8400/0x8973ae90b38d7734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d772d expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596651.716138:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea9021f8400/0x8973ae90b38d7734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d772d expref: 18 pid: 5836 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596651.716146:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6526300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876527964782208:0@lo:104: 00000100:00100000:3.0:1789596651.716164:0:8518:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea900034600 going to sleep for 11 seconds 00000100:00100000:2.0:1789596651.716315:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789596651.716336:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596651.716359:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964781952 00000100:00100000:2.0:1789596651.716365:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964781952 00000100:00100000:2.0:1789596651.716411:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964782080 00000100:00100000:2.0:1789596651.716414:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964782080 00000100:00100000:2.0:1789596651.716426:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964782208 00000100:00100000:2.0:1789596651.716437:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964782208 00000100:00100000:2.0:1789596651.716451:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789596651.716468:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+5:8518:x1876527964781952:12345-0@lo:104: 00010000:00010000:2.0:1789596651.716481:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482600/0x8973ae90b38d785a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7861 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.716527:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789596651.716533:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+5:8518:x1876527964781952:12345-0@lo:104: Request processed in 75us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596651.716550:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789596651.716574:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789596651.716580:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ecec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+4:8518:x1876527964782080:12345-0@lo:104: 00010000:00010000:2.0:1789596651.716587:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d778f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7796 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.716616:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789596651.716622:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ecec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+4:8518:x1876527964782080:12345-0@lo:104: Request processed in 43us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596651.716628:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789596651.716658:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789596651.716664:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa661180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:8518:x1876527964782208:12345-0@lo:104: 00010000:00010000:2.0:1789596651.716685:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d772d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7734 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.716717:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789596651.716723:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa661180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:8518:x1876527964782208:12345-0@lo:104: Request processed in 59us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596651.716727:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789596651.716751:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789596651.716758:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482600/0x8973ae90b38d785a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7861 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.716765:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1482600 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596651.716769:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482600/0x8973ae90b38d785a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d7861 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.716777:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482600/0x8973ae90b38d785a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d7861 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596651.716784:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482600/0x8973ae90b38d785a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d7861 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596651.716790:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789596651.716846:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482600/0x8973ae90b38d785a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7861 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.716852:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596651.716871:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482600/0x8973ae90b38d785a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7861 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.716878:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c1482600/0x8973ae90b38d785a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7861 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.716890:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789596651.716893:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d778f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7796 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.716898:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483600 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596651.716901:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d778f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d7796 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.716913:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d778f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d7796 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596651.716919:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d778f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d7796 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596651.716924:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789596651.716937:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d778f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7796 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.716942:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596651.716955:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d778f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7796 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.716961:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483600/0x8973ae90b38d778f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7796 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.716971:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596651.716973:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d772d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7734 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.716979:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031400 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596651.716982:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d772d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d7734 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.716988:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d772d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d7734 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596651.716994:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d772d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d7734 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596651.717004:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789596651.717018:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d772d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7734 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.717024:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596651.717030:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d772d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7734 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.717036:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d772d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7734 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.717049:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596651.717051:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596651.717052:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596651.717058:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596651.717062:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596651.717072:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964782336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596651.717100:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596651.717141:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964782464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596651.717164:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596651.717182:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596651.717187:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964782592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596651.717207:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596651.717233:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964782336 00000100:00100000:2.0:1789596651.717238:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964782336 00010000:00010000:2.0:1789596651.717256:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7861 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d785a expref: 19 pid: 5834 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596651.717287:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964782464 00000100:00100000:2.0:1789596651.717291:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964782464 00010000:00010000:2.0:1789596651.717304:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea902044200/0x8973ae90b38d7796 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d778f expref: 20 pid: 5836 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596651.717313:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964782592 00000100:00100000:2.0:1789596651.717315:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964782592 00010000:00010000:2.0:1789596651.717326:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea9021f8400/0x8973ae90b38d7734 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d772d expref: 21 pid: 5836 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596651.717337:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789596651.717343:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa660e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+21:3309:x1876527964782336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596651.717353:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596651.717358:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7861 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d785a expref: 21 pid: 5834 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.717367:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7861 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d785a expref: 21 pid: 5834 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.717382:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596651.717410:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa660e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+21:3309:x1876527964782336:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596651.717416:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789596651.717429:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789596651.717433:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa663480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+20:3306:x1876527964782464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596651.717440:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596651.717443:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea902044200/0x8973ae90b38d7796 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d778f expref: 20 pid: 5836 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.717460:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea902044200/0x8973ae90b38d7796 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d778f expref: 20 pid: 5836 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.717470:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596651.717497:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa663480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+20:3306:x1876527964782464:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596651.717503:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789596651.717514:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789596651.717520:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa661f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964782592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596651.717527:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596651.717531:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea9021f8400/0x8973ae90b38d7734 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d772d expref: 19 pid: 5836 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.717549:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea9021f8400/0x8973ae90b38d7734 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d772d expref: 19 pid: 5836 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.717558:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596651.717578:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa661f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964782592:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596651.717584:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789596651.717625:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964782336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596651.717647:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964782592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596651.717654:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964782464:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596651.718061:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7861 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d785a expref: 18 pid: 5834 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596651.718075:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6526d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876527964781952:0@lo:104: 00010000:00010000:3.0:1789596651.718086:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea902044200/0x8973ae90b38d7796 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d778f expref: 17 pid: 5836 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596651.718095:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6526680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876527964782080:0@lo:104: 00010000:00010000:3.0:1789596651.718104:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea9021f8400/0x8973ae90b38d7734 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d772d expref: 16 pid: 5836 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596651.718112:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6526300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876527964782208:0@lo:104: 00000100:00100000:1.0:1789596651.725370:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596651.725714:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944832768 00000100:00100000:2.0:1789596651.725724:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944832768 00010000:00010000:2.0:1789596651.725762:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d791e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c58 expref: 10 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596651.725841:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 24 00000100:00100000:2.0:1789596651.725852:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2353:x1876527944832768:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596651.725868:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596651.725874:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d791e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c58 expref: 10 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.725887:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d791e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c58 expref: 10 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.725908:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d79bf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.725917:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d79bf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.725934:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d79bf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.725942:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d79bf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.725950:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d79bf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.725957:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d79bf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.725963:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88600 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596651.725968:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d79bf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.725983:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d79bf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.725993:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d79bf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596651.726004:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596651.726067:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2353:x1876527944832768:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 215us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596651.726075:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 24 00010000:00010000:3.0:1789596651.731103:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d791e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c58 expref: 9 pid: 5836 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596651.731125:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6524380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876527964781824:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789596651.731158:0:8518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d79bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596651.731168:0:8518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d79bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596651.731175:0:8518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d79bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596651.731182:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d79bf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596652.317059:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596653.339181:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596653.413724:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596653.414395:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944832896 00000100:00100000:3.0:1789596653.414406:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944832896 00000100:00100000:3.0:1789596653.414629:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 171 00000100:00100000:3.0:1789596653.414640:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+9:5592:x1876527944832896:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596653.414657:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596653.414672:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f89200/0x8973ae90b38d79c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344c97 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596653.414693:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f89200/0x8973ae90b38d79c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c97 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596653.414701:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f89200/0x8973ae90b38d79c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c97 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596653.414715:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89200, rc 0) 00000100:00100000:3.0:1789596653.418731:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:5592:x1876527944832896:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 4080us (5004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596653.418744:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 171 00000100:00100000:3.0:1789596653.427692:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596653.427790:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944833024 00000100:00100000:2.0:1789596653.427801:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944833024 00000100:00100000:1.0:1789596653.427899:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 172 00000100:00100000:1.0:1789596653.427913:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:5592:x1876527944833024:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596653.428195:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:5592:x1876527944833024:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 285us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596653.428212:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 172 00000100:00100000:1.0:1789596653.429788:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596653.429880:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944833152 00000100:00100000:3.0:1789596653.429888:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944833152 00000100:00100000:3.0:1789596653.429928:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 173 00000100:00100000:2.0:1789596653.429982:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:5592:x1876527944833152:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596653.430318:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:5592:x1876527944833152:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 380us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596653.430326:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 173 00000100:00100000:3.0:1789596653.436770:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596653.436951:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944833280 00000100:00100000:1.0:1789596653.436962:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944833280 00000100:00100000:1.0:1789596653.437018:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 174 00000100:00100000:1.0:1789596653.437028:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:6141:x1876527944833280:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789596653.437287:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:6141:x1876527944833280:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 260us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596653.437296:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 174 00000100:00100000:3.0:1789596653.448302:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596653.448383:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944833408 00000100:00100000:1.0:1789596653.448393:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944833408 00000100:00100000:1.0:1789596653.448453:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 175 00000100:00100000:1.0:1789596653.448463:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:6141:x1876527944833408:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789596653.448728:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:6141:x1876527944833408:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 265us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596653.448737:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 175 10000000:01000000:2.0:1789596653.469347:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789596653.469354:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea8f66d1800 from 4 10000000:01000000:2.0:1789596653.469359:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789596653.469406:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d79cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596653.469420:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d79cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596653.469449:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d79cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596653.469476:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964782720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789596653.469555:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596653.469609:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c2fce300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596653.469770:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964782720 00000100:00100000:1.0:1789596653.469779:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964782720 00000100:00100000:1.0:1789596653.469853:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789596653.469863:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:5838:x1876527964782720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596653.469876:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596653.469889:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea9021f8800/0x8973ae90b38d79d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d79cd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596653.469911:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea9021f8800/0x8973ae90b38d79d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d79cd expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596653.469930:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea9021f8800/0x8973ae90b38d79d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d79cd expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596653.469938:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea9021f8800, rc 0) 00000100:00100000:1.0:1789596653.469982:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964782720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596653.469989:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789596653.470034:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa661880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964782720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596653.470048:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d79cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d79d4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596653.470057:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d79cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d79d4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596653.470112:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964782848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596653.470136:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596653.470152:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6912c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596653.470166:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964782848 00000100:00100000:1.0:1789596653.470169:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964782848 00000100:00100000:1.0:1789596653.470191:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789596653.470197:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964782848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596653.470421:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964782848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 224us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596653.470428:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789596653.470460:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964782848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596653.470494:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964782976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596653.470542:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596653.470567:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6912c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596653.470579:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964782976 00000100:00100000:1.0:1789596653.470582:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964782976 00000100:00100000:1.0:1789596653.470603:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789596653.470610:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964782976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596653.470751:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964782976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596653.470758:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789596653.470794:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964782976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596653.470985:0:8609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8609:1876527964783104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596653.471018:0:8609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596653.471036:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964783104 00000100:00100000:1.0:1789596653.471040:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964783104 00000100:00100000:1.0:1789596653.471060:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789596653.471066:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:8609:x1876527964783104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596653.471184:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:8609:x1876527964783104:12345-0@lo:502:llog_process_th.0 Request processed in 117us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596653.471191:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789596653.471219:0:8609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6912600 going to sleep for 11 seconds 00000100:00100000:1.0:1789596653.471233:0:8609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8609:1876527964783104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789596653.471253:0:8609:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596653.471268:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596653.471273:0:8609:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789596653.471281:0:8609:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ea8f66d1800 00000020:00000080:1.0:1789596653.471284:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789596653.471349:0:8609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8609:1876527964783232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596653.471385:0:8609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596653.471404:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964783232 00000100:00100000:1.0:1789596653.471408:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964783232 00000100:00100000:1.0:1789596653.471428:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789596653.471434:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:8609:x1876527964783232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596653.471547:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:8609:x1876527964783232:12345-0@lo:502:llog_process_th.0 Request processed in 112us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596653.471553:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789596653.471582:0:8609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff58d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789596653.471593:0:8609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8609:1876527964783232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789596653.471610:0:8609:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596653.471615:0:8609:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596653.471616:0:8609:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789596653.471620:0:8609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789596653.471668:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789596653.471680:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789596653.471687:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d79cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d79d4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596653.471697:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d79cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d79d4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596653.471707:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789596653.471709:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea8f9e94000 from 4 10000000:01000000:1.0:1789596653.471711:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789596653.471739:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d79db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596653.471747:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d79db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596653.471755:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d79db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596653.471768:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964783360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789596653.471790:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596653.471803:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6912840 going to sleep for 11 seconds 00000100:00100000:1.0:1789596653.471835:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964783360 00000100:00100000:1.0:1789596653.471839:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964783360 00000100:00100000:1.0:1789596653.471861:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789596653.471866:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964783360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596653.471874:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596653.471885:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d79e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d79db expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596653.471903:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d79e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d79db expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596653.471912:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d79e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d79db expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596653.471920:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea9021f9200, rc 0) 00000100:00100000:1.0:1789596653.471948:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964783360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596653.471953:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789596653.471989:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964783360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596653.471999:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d79db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d79e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596653.472007:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d79db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d79e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596653.472040:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964783488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596653.472061:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596653.472073:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff58d780 going to sleep for 11 seconds 00000100:00100000:1.0:1789596653.472082:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964783488 00000100:00100000:1.0:1789596653.472085:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964783488 00000100:00100000:1.0:1789596653.472104:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789596653.472110:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964783488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596653.472278:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964783488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596653.472284:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789596653.472313:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964783488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596653.472336:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964783616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596653.472366:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596653.472378:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff58d780 going to sleep for 11 seconds 00000100:00100000:1.0:1789596653.472387:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964783616 00000100:00100000:1.0:1789596653.472390:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964783616 00000100:00100000:1.0:1789596653.472409:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789596653.472415:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964783616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596653.472518:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964783616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596653.472544:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789596653.472577:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964783616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596653.482114:0:8610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa660700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8610:1876527964783744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596653.482206:0:8610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596653.482247:0:8610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c2fcecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596653.485405:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964783744 00000100:00100000:1.0:1789596653.485421:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964783744 00000100:00100000:1.0:1789596653.485498:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789596653.485509:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:8610:x1876527964783744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596653.486008:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:8610:x1876527964783744:12345-0@lo:502:llog_process_th.0 Request processed in 500us (3800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596653.486018:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789596653.486091:0:8610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa660700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8610:1876527964783744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789596653.486124:0:8610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596653.486135:0:8610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596653.486137:0:8610:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789596653.486144:0:8610:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ea8f9e94000 00000020:00000080:1.0:1789596653.486146:0:8610:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789596653.489253:0:8610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa251c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8610:1876527964783872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596653.489342:0:8610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596653.489394:0:8610:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c30bf300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596653.489965:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964783872 00000100:00100000:1.0:1789596653.489974:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964783872 00000100:00100000:1.0:1789596653.490021:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789596653.490030:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:8610:x1876527964783872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596653.490266:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:8610:x1876527964783872:12345-0@lo:502:llog_process_th.0 Request processed in 236us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596653.490274:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789596653.490338:0:8610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa251c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8610:1876527964783872:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789596653.490369:0:8610:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596653.490377:0:8610:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596653.490385:0:8610:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789596653.490391:0:8610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789596653.492350:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789596653.492381:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789596653.492394:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d79db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d79e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596653.492410:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d79db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d79e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596653.492422:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789596653.492424:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea8e4942800 from 4 10000000:01000000:0.0:1789596653.492427:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789596653.492470:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d79e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596653.492489:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d79e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596653.492500:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d79e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596653.492538:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa250e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964784000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789596653.492602:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596653.492643:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c30bf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596653.495761:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964784000 00000100:00100000:2.0:1789596653.495776:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964784000 00000100:00100000:2.0:1789596653.495965:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789596653.495975:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964784000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596653.495992:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596653.496011:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8ef427a00/0x8973ae90b38d79f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d79e9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596653.496037:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ef427a00/0x8973ae90b38d79f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d79e9 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596653.496048:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8ef427a00/0x8973ae90b38d79f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d79e9 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596653.496056:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427a00, rc 0) 00000100:00100000:2.0:1789596653.496126:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964784000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (3524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596653.496133:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789596653.497648:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa250e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964784000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596653.497675:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d79e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d79f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596653.497689:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d79e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d79f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596653.497766:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa250e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964784128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596653.497831:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596653.497869:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c30bf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596653.497889:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964784128 00000100:00100000:0.0:1789596653.497894:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964784128 00000100:00100000:0.0:1789596653.497934:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789596653.497942:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964784128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596653.498197:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964784128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596653.498204:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789596653.498249:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa250e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964784128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596653.498278:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa250e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964784256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596653.498314:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596653.498328:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c30bf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596653.498340:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964784256 00000100:00100000:0.0:1789596653.498343:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964784256 00000100:00100000:0.0:1789596653.498363:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789596653.498369:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964784256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596653.498501:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964784256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596653.498508:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789596653.498561:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa250e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964784256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596653.500288:0:8616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa660a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8616:1876527964784384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596653.500353:0:8616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596653.500385:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964784384 00000100:00100000:2.0:1789596653.500392:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964784384 00000100:00100000:2.0:1789596653.500428:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789596653.500435:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:8616:x1876527964784384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596653.502962:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:8616:x1876527964784384:12345-0@lo:502:llog_process_th.0 Request processed in 2518us (2601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596653.502976:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789596653.503047:0:8616:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c31579c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596653.503072:0:8616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa660a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8616:1876527964784384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789596653.503107:0:8616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789596653.503117:0:8616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596653.503120:0:8616:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789596653.503127:0:8616:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ea8e4942800 00000020:00000080:2.0:1789596653.503130:0:8616:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789596653.503226:0:8616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa660a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8616:1876527964784512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596653.503270:0:8616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596653.503294:0:8616:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c31579c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596653.506958:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964784512 00000100:00100000:0.0:1789596653.506974:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964784512 00000100:00100000:0.0:1789596653.507038:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789596653.507048:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:8616:x1876527964784512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596653.507310:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:8616:x1876527964784512:12345-0@lo:502:llog_process_th.0 Request processed in 263us (4039us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596653.507317:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1789596653.508609:0:8616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa660a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:8616:1876527964784512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789596653.508651:0:8616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789596653.508660:0:8616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596653.508662:0:8616:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789596653.508668:0:8616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789596653.508738:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789596653.508759:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789596653.508769:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d79e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d79f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596653.508785:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d79e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d79f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596653.597669:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964784640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596653.597746:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596653.598138:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964784640 00000100:00100000:1.0:1789596653.598147:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964784640 00000100:00100000:1.0:1789596653.598216:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789596653.598225:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964784640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789596653.598265:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789596653.598317:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964784640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596653.598324:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1789596653.599711:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789596653.601328:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c6ec3b80 x1876527964784640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596653.601359:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964784640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596653.932055:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596653.932104:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596653.932203:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944833536 00000100:00100000:1.0:1789596653.932213:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944833536 00000100:00100000:3.0:1789596653.932265:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944833664 00000100:00100000:3.0:1789596653.932291:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944833664 00000100:00100000:1.0:1789596653.932300:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 28 00000100:00100000:1.0:1789596653.932314:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2352:x1876527944833536:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596653.932378:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 10 00000100:00100000:3.0:1789596653.932394:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2352:x1876527944833664:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596653.932403:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2352:x1876527944833536:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 86us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596653.932416:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 28 00000100:00100000:3.0:1789596653.932470:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2352:x1876527944833664:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 80us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596653.932480:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 10 00000100:00080000:0.0:1789596653.932578:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789596653.932585:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596653.937696:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596653.938806:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944833792 00000100:00100000:2.0:1789596653.938858:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944833792 00000100:00100000:2.0:1789596653.938936:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 11 00000100:00100000:2.0:1789596653.938958:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2352:x1876527944833792:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596653.939057:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2352:x1876527944833792:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 111us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596653.939065:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 11 00000100:00080000:0.0:1789596653.939635:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789596654.109810:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596654.110096:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876527964785024:0@lo:400:kworker.0 00000100:00100000:1.0:1789596654.110171:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596654.110230:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789596654.110237:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876527964784896:0@lo:400:kworker.0 00000100:00100000:1.0:1789596654.110278:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596654.110314:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964785024 00000100:00100000:1.0:1789596654.110323:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964785024 00000100:00080000:0.0:1789596654.110857:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596654.113347:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964785152:0@lo:400:kworker.0 00000100:00100000:3.0:1789596654.113460:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596654.113679:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964784768:0@lo:400:kworker.0 00000100:00100000:3.0:1789596654.113712:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596654.113783:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964785152 00000100:00100000:3.0:1789596654.113794:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964785152 00000100:00100000:3.0:1789596654.113870:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789596654.113882:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964785152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596654.113952:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964785152:12345-0@lo:400:kworker.0 Request processed in 72us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596654.113960:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789596654.114025:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8fa662d80 x1876527964785152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596654.114037:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964784896 00000100:00100000:3.0:1789596654.114046:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964785152:0@lo:400:kworker.0 00000100:00100000:1.0:1789596654.114054:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964784896 00000100:00100000:3.0:1789596654.114179:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964784768 00000100:00100000:3.0:1789596654.114186:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964784768 00000100:00100000:3.0:1789596654.114223:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789596654.114229:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964784768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596654.114344:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789596654.114366:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876527964785024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596654.114892:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876527964785024:12345-0@lo:400:kworker.0 Request processed in 529us (4718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596654.114901:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789596654.114925:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789596654.114932:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876527964784896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596654.114964:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876527964784896:12345-0@lo:400:kworker.0 Request processed in 33us (4685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596654.114970:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789596654.115023:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876527964784896:0@lo:400:kworker.0 00000100:00100000:0.0:1789596654.115036:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876527964785024:0@lo:400:kworker.0 00000100:00100000:3.0:1789596654.115316:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964784768:12345-0@lo:400:kworker.0 Request processed in 1082us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596654.115328:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789596654.115763:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964785408:0@lo:400:kworker.0 00000100:00100000:2.0:1789596654.115807:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596654.115870:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964785408 00000100:00100000:2.0:1789596654.115877:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964785408 00000100:00100000:2.0:1789596654.115926:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789596654.115934:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964785408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596654.115974:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964785408:12345-0@lo:400:kworker.0 Request processed in 41us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596654.115980:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789596654.116015:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8fa662680 x1876527964785408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596654.116026:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964785408:0@lo:400:kworker.0 00000100:00100000:3.0:1789596654.116672:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964785280:0@lo:400:kworker.0 00000100:00100000:3.0:1789596654.116720:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596654.116787:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964785280 00000100:00100000:3.0:1789596654.116792:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964785280 00000100:00100000:3.0:1789596654.116875:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789596654.116886:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964785280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596654.116944:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964785280:12345-0@lo:400:kworker.0 Request processed in 57us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596654.116944:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964784768:0@lo:400:kworker.0 00000100:00100000:3.0:1789596654.116977:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789596654.117019:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596654.117025:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964785280:0@lo:400:kworker.0 00000100:00080000:1.0:1789596654.117028:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789596654.365738:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596654.619652:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964785536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596654.619787:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596654.620188:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964785536 00000100:00100000:3.0:1789596654.620198:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964785536 00000100:00100000:3.0:1789596654.620256:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789596654.620268:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964785536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789596654.620314:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596654.620375:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964785536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596654.620381:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789596654.620470:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8f6526d80 x1876527964785536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596670 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596654.620502:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964785536:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789596655.387052:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596656.412554:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596657.434994:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789596658.210578:0:8818:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg244-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1789596658.459854:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596658.716937:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789596658.716961:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964785664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596658.717043:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596658.717120:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964785664 00000100:00100000:1.0:1789596658.717128:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964785664 00000100:00100000:1.0:1789596658.717182:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789596658.717191:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964785664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789596658.717227:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789596658.717271:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964785664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596658.717278:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1789596658.717300:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789596658.717415:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea900466300 x1876527964785664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596674 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596658.717434:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964785664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596659.046488:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596659.046582:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596659.046619:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596659.046643:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944834304 00000100:00100000:3.0:1789596659.046646:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596659.046653:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944834304 00000100:00100000:3.0:1789596659.046669:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944833920 00000100:00100000:3.0:1789596659.046672:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944833920 00000100:00100000:2.0:1789596659.046707:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944834176 00000100:00100000:2.0:1789596659.046709:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944834176 00000100:00100000:3.0:1789596659.046711:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 192 00000100:00100000:3.0:1789596659.046719:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2352:x1876527944833920:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596659.046725:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 14 00000100:00100000:2.0:1789596659.046730:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2352:x1876527944834304:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596659.046784:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2352:x1876527944833920:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 66us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596659.046792:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 192 00000100:00100000:0.0:1789596659.047066:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944834048 00000100:00100000:0.0:1789596659.047071:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944834048 00000100:00100000:0.0:1789596659.047145:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 32 00000100:00100000:0.0:1789596659.047153:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2352:x1876527944834048:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596659.049074:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2352:x1876527944834304:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 2334us (2482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596659.049088:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 14 00000100:00100000:2.0:1789596659.049119:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 15 00000100:00100000:2.0:1789596659.049130:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2352:x1876527944834176:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596659.049182:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6526d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2352:x1876527944834176:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 55us (2534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596659.049188:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 15 00000100:00080000:2.0:1789596659.049223:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789596659.049228:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789596659.049230:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596659.049722:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2352:x1876527944834048:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 2566us (3322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596659.049732:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 32 00000100:00100000:1.0:1789596659.232030:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964785792:0@lo:400:kworker.0 00000100:00100000:1.0:1789596659.232105:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596659.232271:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964785792 00000100:00100000:0.0:1789596659.232279:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964785792 00000100:00100000:0.0:1789596659.232337:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789596659.232346:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3309:x1876527964785792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596659.235736:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964786176:0@lo:400:kworker.0 00000100:00100000:3.0:1789596659.235813:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596659.235888:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596659.235909:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964786304:0@lo:400:kworker.0 00000100:00100000:3.0:1789596659.235936:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596659.235967:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964785920:0@lo:400:kworker.0 00000100:00100000:3.0:1789596659.236003:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596659.236021:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964786432:0@lo:400:kworker.0 00000100:00100000:3.0:1789596659.236045:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596659.236061:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596659.236067:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964786048:0@lo:400:kworker.0 00000100:00100000:3.0:1789596659.236087:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596659.236120:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964786304 00000100:00100000:3.0:1789596659.236128:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964786304 00000100:00100000:3.0:1789596659.236171:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964785920 00000100:00100000:3.0:1789596659.236174:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964785920 00000100:00100000:3.0:1789596659.236186:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964786048 00000100:00100000:3.0:1789596659.236188:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964786048 00000100:00100000:3.0:1789596659.236214:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789596659.236222:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876527964786304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596659.236271:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876527964786304:12345-0@lo:400:kworker.0 Request processed in 49us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596659.236278:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789596659.236296:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789596659.236302:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964785920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596659.236347:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964785920:12345-0@lo:400:kworker.0 Request processed in 45us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596659.236353:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789596659.236364:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789596659.236371:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964786048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596659.236419:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964786048:12345-0@lo:400:kworker.0 Request processed in 49us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596659.236426:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789596659.236732:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964786304:0@lo:400:kworker.0 00000100:00100000:3.0:1789596659.236759:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964786048:0@lo:400:kworker.0 00000100:00100000:3.0:1789596659.236769:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964785920:0@lo:400:kworker.0 00000100:00100000:2.0:1789596659.236929:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964786176 00000100:00100000:2.0:1789596659.236935:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964786176 00000100:00100000:2.0:1789596659.236970:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964786432 00000100:00100000:2.0:1789596659.236974:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964786432 00000100:00100000:2.0:1789596659.236990:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789596659.236996:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964786176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596659.237040:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964786176:12345-0@lo:400:kworker.0 Request processed in 44us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596659.237058:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789596659.237072:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789596659.237078:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964786432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596659.237111:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964786432:12345-0@lo:400:kworker.0 Request processed in 34us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596659.237117:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789596659.237134:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789596659.237139:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789596659.237687:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8f6525f80 x1876527964786176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596659.237699:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964786176:0@lo:400:kworker.0 00010000:00080000:2.0:1789596659.237729:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8f6524e00 x1876527964786432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596659.237738:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964786432:0@lo:400:kworker.0 00000100:00100000:0.0:1789596659.240546:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3309:x1876527964785792:12345-0@lo:400:kworker.0 Request processed in 8191us (8431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596659.240560:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789596659.240695:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964785792:0@lo:400:kworker.0 00010000:00010000:2.0:1789596659.483033:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596659.740229:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964786560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596659.740304:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596659.741338:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964786560 00000100:00100000:3.0:1789596659.741348:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964786560 00000100:00100000:3.0:1789596659.741409:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789596659.741418:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964786560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789596659.741451:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596659.741522:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964786560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596659.741529:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1789596659.741993:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8f6527100 x1876527964786560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596659.742014:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964786560:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789596660.507032:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596661.531884:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596662.555337:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596663.579798:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596663.835208:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596663.840441:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964786688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596663.840566:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596663.841144:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964786688 00000100:00100000:2.0:1789596663.841157:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964786688 00000100:00100000:2.0:1789596663.841243:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789596663.841258:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964786688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596663.841309:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789596663.841372:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964786688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596663.841389:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789596663.841418:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789596663.843222:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea900466300 x1876527964786688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596679 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596663.843252:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900466300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964786688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596664.189179:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596664.189235:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596664.189270:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596664.189294:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596664.192562:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944834560 00000100:00100000:2.0:1789596664.192588:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944834560 00000100:00100000:2.0:1789596664.192726:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 36 00000100:00100000:2.0:1789596664.192743:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2352:x1876527944834560:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596664.192905:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900466300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2352:x1876527944834560:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 167us (3740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596664.192913:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 36 00000100:00100000:2.0:1789596664.192950:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944834688 00000100:00100000:2.0:1789596664.192956:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944834688 00000100:00100000:2.0:1789596664.192988:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944834816 00000100:00100000:2.0:1789596664.192992:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944834816 00000100:00100000:2.0:1789596664.193010:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 10 00000100:00100000:2.0:1789596664.193017:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900465c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2350:x1876527944834688:12345-192.168.202.44@tcp:9:kworker.0 00000020:00000080:2.0:1789596664.193057:0:6695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d792c 00000100:00080000:2.0:1789596664.193073:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9ea8f9f61800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789596664.193138:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789596664.193580:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900465c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+2:2350:x1876527944834688:12345-192.168.202.44@tcp:9:kworker.0 Request processed in 561us (4307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596664.193589:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 10 00000100:00100000:2.0:1789596664.193608:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 11 00000100:00100000:2.0:1789596664.193616:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900465500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2350:x1876527944834816:12345-192.168.202.44@tcp:9:kworker.0 00000020:00000080:2.0:1789596664.193634:0:6695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7933 00000100:00080000:2.0:1789596664.193643:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9ea900071000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789596664.193672:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789596664.193917:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900465500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+2:2350:x1876527944834816:12345-192.168.202.44@tcp:9:kworker.0 Request processed in 301us (4620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596664.193924:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 11 00010000:00010000:2.0:1789596664.194182:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596664.194189:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789596664.194356:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789596664.194362:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789596664.194365:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596664.194720:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944834432 00000100:00100000:0.0:1789596664.194729:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944834432 00000100:00100000:0.0:1789596664.194786:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 194 00000100:00100000:0.0:1789596664.194795:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2352:x1876527944834432:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596664.194868:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2352:x1876527944834432:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 74us (5633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596664.194875:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 194 00000100:00100000:1.0:1789596664.353226:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964786816:0@lo:400:kworker.0 00000100:00100000:1.0:1789596664.353335:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596664.353751:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789596664.353760:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964787200:0@lo:400:kworker.0 00000100:00100000:1.0:1789596664.353799:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596664.353868:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964786816 00000100:00100000:1.0:1789596664.353878:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964786816 00000100:00100000:1.0:1789596664.353938:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789596664.353948:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3309:x1876527964786816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596664.354006:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3309:x1876527964786816:12345-0@lo:400:kworker.0 Request processed in 58us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596664.354013:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789596664.354051:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964786944:0@lo:400:kworker.0 00000100:00100000:1.0:1789596664.354080:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596664.354103:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596664.354109:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964787072:0@lo:400:kworker.0 00000100:00100000:1.0:1789596664.354129:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596664.354156:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964787200 00000100:00100000:1.0:1789596664.354160:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964787200 00000100:00100000:1.0:1789596664.354194:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789596664.354218:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900464000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964787200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596664.354254:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900464000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964787200:12345-0@lo:400:kworker.0 Request processed in 37us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596664.354261:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789596664.354285:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964786944 00000100:00100000:1.0:1789596664.354289:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964786944 00000100:00100000:1.0:1789596664.354317:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964787072 00000100:00100000:1.0:1789596664.354320:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964787072 00000100:00100000:1.0:1789596664.354345:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789596664.354352:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964786944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596664.354387:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900467800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964786944:12345-0@lo:400:kworker.0 Request processed in 35us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596664.354393:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789596664.354405:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789596664.354411:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964787072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596664.354451:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900465180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964787072:12345-0@lo:400:kworker.0 Request processed in 40us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596664.354457:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1789596664.360578:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8fa663b80 x1876527964787200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596664.360603:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964787200:0@lo:400:kworker.0 00000100:00100000:0.0:1789596664.360616:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964786816:0@lo:400:kworker.0 00000100:00080000:0.0:1789596664.360678:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596664.360721:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa661c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964787072:0@lo:400:kworker.0 00000100:00100000:0.0:1789596664.360735:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964786944:0@lo:400:kworker.0 00000100:00100000:2.0:1789596664.365979:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596664.366014:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964787328:0@lo:400:kworker.0 00000100:00100000:2.0:1789596664.366107:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596664.366168:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789596664.366177:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964787456:0@lo:400:kworker.0 00000100:00100000:2.0:1789596664.366208:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596664.366245:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964787456 00000100:00100000:2.0:1789596664.366256:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964787456 00000100:00100000:2.0:1789596664.366331:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789596664.366342:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964787456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596664.366404:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964787456:12345-0@lo:400:kworker.0 Request processed in 64us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596664.366412:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1789596664.366543:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8fa660380 x1876527964787456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596664.366562:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964787456:0@lo:400:kworker.0 00000100:00080000:2.0:1789596664.366593:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596664.366609:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964787328 00000100:00100000:2.0:1789596664.366613:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964787328 00000100:00100000:2.0:1789596664.366759:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789596664.366767:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876527964787328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596664.366811:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876527964787328:12345-0@lo:400:kworker.0 Request processed in 45us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596664.366880:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789596664.366911:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964787328:0@lo:400:kworker.0 00000100:00080000:2.0:1789596664.366929:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789596664.608783:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596664.861866:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596664.861892:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964787584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596664.861962:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596664.862136:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964787584 00000100:00100000:0.0:1789596664.862144:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964787584 00000100:00100000:0.0:1789596664.862189:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789596664.862198:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff38b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964787584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596664.862229:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596664.862275:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff38b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964787584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596664.862282:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789596664.862321:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8ff388e00 x1876527964787584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596664.862338:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964787584:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1789596665.091493:0:9062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg244-server.virtnet: executing yml_node 00000001:00100000:3.0:1789596665.463274:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1fdd0e7b-fe25-4537-b350-ae6aecfab059 00000020:00000080:3.0:1789596665.463287:0:6719:0:(genops.c:885:class_export_put()) final put ffff9ea8f9f60800/1fdd0e7b-fe25-4537-b350-ae6aecfab059 00000020:00000080:2.0:1789596665.464488:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8f9f60800/1fdd0e7b-fe25-4537-b350-ae6aecfab059 for lustre-OST0000 00000020:00000080:2.0:1789596665.464551:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea8f9f61800 for lustre-OST0000 00010000:00010000:2.0:1789596665.630600:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596666.651017:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789596667.469564:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1fdd0e7b-fe25-4537-b350-ae6aecfab059 00000020:00000080:0.0:1789596667.469574:0:7655:0:(genops.c:885:class_export_put()) final put ffff9ea900073800/1fdd0e7b-fe25-4537-b350-ae6aecfab059 00000020:00000080:2.0:1789596667.469630:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea900073800/1fdd0e7b-fe25-4537-b350-ae6aecfab059 for lustre-OST0001 00000020:00000080:2.0:1789596667.469686:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea900071000 for lustre-OST0001 00010000:00010000:0.0:1789596667.675067:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596668.699010:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596668.956992:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596668.957017:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964787712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596668.957099:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596668.957187:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964787712 00000100:00100000:0.0:1789596668.957194:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964787712 00000100:00100000:0.0:1789596668.957252:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789596668.957276:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964787712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789596668.957309:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596668.957355:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff388e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964787712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596668.957362:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1789596668.957424:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea900464a80 x1876527964787712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596668.957442:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900464a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964787712:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789596668.957675:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596669.298607:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596669.298655:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596669.299102:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944834944 00000100:00100000:3.0:1789596669.299121:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944834944 00000100:00100000:3.0:1789596669.299184:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 196 00000100:00100000:3.0:1789596669.299194:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2351:x1876527944834944:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596669.299277:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2351:x1876527944834944:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 83us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596669.299298:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 196 00000100:00100000:2.0:1789596669.301085:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944835072 00000100:00100000:2.0:1789596669.301099:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944835072 00000100:00100000:2.0:1789596669.301235:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 40 00000100:00100000:2.0:1789596669.301247:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2352:x1876527944835072:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596669.301315:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900465880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2352:x1876527944835072:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 71us (2658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596669.301321:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 40 00000100:00080000:0.0:1789596669.307517:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596669.467645:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964788224:0@lo:400:kworker.0 00000100:00100000:3.0:1789596669.467730:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596669.467807:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789596669.467841:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964787840:0@lo:400:kworker.0 00000100:00100000:3.0:1789596669.467875:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596669.467896:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964788352:0@lo:400:kworker.0 00000100:00100000:3.0:1789596669.467921:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596669.468208:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964788224 00000100:00100000:0.0:1789596669.468218:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964788224 00000100:00100000:0.0:1789596669.468274:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789596669.468285:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964788224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596669.468513:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876527964788096:0@lo:400:kworker.0 00000100:00100000:2.0:1789596669.468547:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596669.468571:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789596669.468577:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876527964787968:0@lo:400:kworker.0 00000100:00100000:2.0:1789596669.468597:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596669.468614:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964788480:0@lo:400:kworker.0 00000100:00100000:2.0:1789596669.468657:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596669.469200:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789596669.469211:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789596669.469513:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964788224:12345-0@lo:400:kworker.0 Request processed in 1228us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596669.469522:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789596669.469541:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964788480 00000100:00100000:0.0:1789596669.469546:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964788480 00000100:00100000:0.0:1789596669.469576:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789596669.469582:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964788480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596669.469629:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964788480:12345-0@lo:400:kworker.0 Request processed in 48us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596669.469650:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1789596669.469668:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789596669.469709:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8ff388380 x1876527964788224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596669.469739:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964788224:0@lo:400:kworker.0 00000100:00100000:1.0:1789596669.469774:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964787840 00000100:00100000:1.0:1789596669.469796:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964787840 00000100:00100000:2.0:1789596669.469862:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964788352 00000100:00100000:2.0:1789596669.469870:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964788352 00000100:00100000:1.0:1789596669.469944:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789596669.469957:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964787840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596669.470075:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964787840:12345-0@lo:400:kworker.0 Request processed in 114us (2190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596669.470082:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789596669.470206:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964787840:0@lo:400:kworker.0 00000100:00080000:3.0:1789596669.470674:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596669.470767:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964788096 00000100:00100000:0.0:1789596669.470774:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964788096 00000100:00100000:2.0:1789596669.471691:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964787968 00000100:00100000:2.0:1789596669.471698:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964787968 00000100:00100000:0.0:1789596669.471874:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789596669.471885:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876527964788352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596669.471990:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876527964788352:12345-0@lo:400:kworker.0 Request processed in 108us (4067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596669.471996:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789596669.472014:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789596669.472020:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876527964788096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596669.472050:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876527964788096:12345-0@lo:400:kworker.0 Request processed in 30us (3502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596669.472067:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789596669.472090:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596669.472139:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964788352:0@lo:400:kworker.0 00000100:00100000:2.0:1789596669.472369:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789596669.472388:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876527964787968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596669.472435:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876527964787968:12345-0@lo:400:kworker.0 Request processed in 59us (3836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596669.472441:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789596669.484627:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876527964787968:0@lo:400:kworker.0 00010000:00080000:3.0:1789596669.484662:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8ff38aa00 x1876527964788480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596669.484674:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964788480:0@lo:400:kworker.0 00000100:00100000:3.0:1789596669.484695:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876527964788096:0@lo:400:kworker.0 00010000:00010000:0.0:1789596669.734259:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596669.980323:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596669.980355:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964788608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596669.980469:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596669.980730:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964788608 00000100:00100000:0.0:1789596669.980742:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964788608 00000100:00100000:0.0:1789596669.980813:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789596669.980855:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964788608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596669.980905:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596669.980969:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964788608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596669.980976:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1789596669.981083:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8ff38a680 x1876527964788608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596669.981108:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964788608:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1789596670.495906:0:9256:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:0.0:1789596670.747215:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596671.771611:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596672.798470:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789596672.953681:0:9354:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:0.0:1789596673.832175:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596674.075294:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964788736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596674.075378:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596674.075504:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964788736 00000100:00100000:1.0:1789596674.075512:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964788736 00000100:00100000:1.0:1789596674.075584:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789596674.075594:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964788736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789596674.075628:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789596674.075693:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964788736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596674.075701:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1789596674.075780:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea900464e00 x1876527964788736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596674.075811:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964788736:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789596674.075875:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596674.410604:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596674.410652:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596674.410711:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944835328 00000100:00100000:3.0:1789596674.410721:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944835328 00000100:00100000:3.0:1789596674.410790:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 44 00000100:00100000:3.0:1789596674.410800:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2351:x1876527944835328:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596674.410907:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2351:x1876527944835328:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 108us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596674.410915:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 44 00000100:00080000:2.0:1789596674.410992:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596674.411043:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944835200 00000100:00100000:1.0:1789596674.411048:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944835200 00000100:00100000:1.0:1789596674.411151:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 198 00000100:00100000:1.0:1789596674.411160:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2351:x1876527944835200:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596674.411286:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2351:x1876527944835200:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 126us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596674.411361:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 198 00000100:00100000:0.0:1789596674.588042:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876527964789120:0@lo:400:kworker.0 00000100:00100000:0.0:1789596674.588127:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596674.588200:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789596674.588208:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876527964788992:0@lo:400:kworker.0 00000100:00100000:0.0:1789596674.588232:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596674.588265:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964789120 00000100:00100000:0.0:1789596674.588272:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964789120 00000100:00100000:0.0:1789596674.588322:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964788992 00000100:00100000:0.0:1789596674.588335:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964788992 00000100:00100000:0.0:1789596674.588353:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789596674.588360:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff38b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876527964789120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596674.588407:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff38b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876527964789120:12345-0@lo:400:kworker.0 Request processed in 47us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596674.588415:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789596674.588434:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789596674.588440:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876527964788992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596674.588467:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876527964788992:12345-0@lo:400:kworker.0 Request processed in 27us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596674.588473:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789596674.588512:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff389c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876527964788992:0@lo:400:kworker.0 00000100:00100000:0.0:1789596674.588523:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876527964789120:0@lo:400:kworker.0 00000100:00100000:1.0:1789596674.588694:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964789248:0@lo:400:kworker.0 00000100:00100000:1.0:1789596674.588725:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596674.588753:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789596674.588759:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964788864:0@lo:400:kworker.0 00000100:00100000:1.0:1789596674.588786:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596674.588810:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964789376:0@lo:400:kworker.0 00000100:00100000:1.0:1789596674.588876:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596674.588902:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964789248 00000100:00100000:1.0:1789596674.588906:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964789248 00000100:00100000:1.0:1789596674.588933:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789596674.588940:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876527964789248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596674.588976:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900467480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876527964789248:12345-0@lo:400:kworker.0 Request processed in 36us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596674.588982:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789596674.589002:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964788864 00000100:00100000:1.0:1789596674.589005:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964788864 00000100:00100000:1.0:1789596674.589025:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789596674.589031:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964788864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596674.589059:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964788864:12345-0@lo:400:kworker.0 Request processed in 28us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596674.589065:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789596674.589099:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964788864:0@lo:400:kworker.0 00000100:00100000:1.0:1789596674.589109:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964789248:0@lo:400:kworker.0 00000100:00080000:2.0:1789596674.589838:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596674.589908:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964789376 00000100:00100000:0.0:1789596674.589915:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964789376 00000100:00100000:0.0:1789596674.589965:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789596674.589972:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964789376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596674.590027:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900465f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964789376:12345-0@lo:400:kworker.0 Request processed in 56us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596674.590034:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1789596674.590086:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8ff388000 x1876527964789376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596674.590098:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964789376:0@lo:400:kworker.0 00000100:00080000:2.0:1789596674.590153:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789596674.843014:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789596675.084556:0:9451:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:2.0:1789596675.099043:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964789504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596675.099123:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596675.099232:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964789504 00000100:00100000:0.0:1789596675.099241:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964789504 00000100:00100000:0.0:1789596675.099301:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789596675.099310:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964789504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596675.099354:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596675.099401:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964789504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596675.099407:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789596675.099583:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8ff388000 x1876527964789504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596675.099612:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964789504:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789596675.867394:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789596676.726112:0:9500:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 16 18:11:15 EDT 2026 00010000:00010000:2.0:1789596676.891536:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596677.920284:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596678.948988:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596679.195537:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964789632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596679.195609:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596679.196411:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964789632 00000100:00100000:3.0:1789596679.196421:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964789632 00000100:00100000:2.0:1789596679.196743:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789596679.196754:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964789632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596679.196791:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789596679.196879:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff38bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964789632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596679.196886:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1789596679.197061:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea900467100 x1876527964789632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596679.197081:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964789632:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789596679.197467:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596679.528635:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596679.528680:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596679.528894:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944835584 00000100:00100000:3.0:1789596679.528905:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944835584 00000100:00100000:3.0:1789596679.528972:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 48 00000100:00100000:3.0:1789596679.528983:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2353:x1876527944835584:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596679.529065:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2353:x1876527944835584:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 84us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596679.529072:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 48 00000100:00100000:1.0:1789596679.529308:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944835456 00000100:00100000:1.0:1789596679.529313:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944835456 00000100:00100000:1.0:1789596679.529350:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 200 00000100:00100000:1.0:1789596679.529357:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2353:x1876527944835456:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596679.529397:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2353:x1876527944835456:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 40us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596679.529404:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 200 00000100:00080000:0.0:1789596679.529557:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596679.707035:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964790016:0@lo:400:kworker.0 00000100:00100000:1.0:1789596679.707103:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596679.707154:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596679.707161:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964790144:0@lo:400:kworker.0 00000100:00100000:1.0:1789596679.707196:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596679.707353:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900464380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964789760:0@lo:400:kworker.0 00000100:00100000:0.0:1789596679.707394:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596679.707416:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964790272:0@lo:400:kworker.0 00000100:00100000:0.0:1789596679.707440:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596679.707459:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596679.707464:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964789888:0@lo:400:kworker.0 00000100:00100000:0.0:1789596679.707484:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596679.707509:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964790272 00000100:00100000:0.0:1789596679.707516:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964790272 00000100:00100000:0.0:1789596679.707570:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789596679.707579:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964790272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596679.707625:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964790272:12345-0@lo:400:kworker.0 Request processed in 47us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596679.707631:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1789596679.707652:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789596679.707678:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea900464e00 x1876527964790272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596679.707692:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900464e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964790272:0@lo:400:kworker.0 00000100:00100000:2.0:1789596679.707855:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964789760 00000100:00100000:2.0:1789596679.707860:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964789760 00000100:00100000:2.0:1789596679.707891:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789596679.707898:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964789760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596679.707937:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964789760:12345-0@lo:400:kworker.0 Request processed in 40us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596679.707944:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789596679.707967:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964790016 00000100:00100000:2.0:1789596679.707970:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964790016 00000100:00100000:2.0:1789596679.707991:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964790144 00000100:00100000:2.0:1789596679.707994:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964790144 00000100:00100000:2.0:1789596679.708005:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964789888 00000100:00100000:2.0:1789596679.708007:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964789888 00000100:00100000:2.0:1789596679.708032:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789596679.708038:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964790016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596679.708066:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900464a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964790016:12345-0@lo:400:kworker.0 Request processed in 29us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596679.708072:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789596679.708094:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789596679.708099:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964790144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596679.708125:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964790144:12345-0@lo:400:kworker.0 Request processed in 26us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596679.708130:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789596679.708139:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789596679.708144:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964789888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596679.708169:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964789888:12345-0@lo:400:kworker.0 Request processed in 25us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596679.708173:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1789596679.708186:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596679.708201:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964789888:0@lo:400:kworker.0 00000100:00100000:2.0:1789596679.708210:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900464380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964789760:0@lo:400:kworker.0 00000100:00100000:1.0:1789596679.708401:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964790144:0@lo:400:kworker.0 00000100:00100000:1.0:1789596679.708411:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900467b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964790016:0@lo:400:kworker.0 00010000:00010000:2.0:1789596679.962979:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596680.225462:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964790400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596680.225539:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596680.225930:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964790400 00000100:00100000:0.0:1789596680.225940:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964790400 00000100:00100000:0.0:1789596680.225995:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789596680.226004:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964790400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596680.226049:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596680.226105:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964790400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596680.226112:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1789596680.226311:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8ff389500 x1876527964790400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596680.226330:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964790400:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789596680.986958:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596682.011091:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596683.043371:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596684.059693:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596684.315477:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964790528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596684.315555:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596684.316673:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964790528 00000100:00100000:0.0:1789596684.316685:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964790528 00000100:00100000:0.0:1789596684.316754:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789596684.316765:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964790528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789596684.316800:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596684.316889:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964790528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596684.316897:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789596684.316966:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789596684.317201:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8f67c4700 x1876527964790528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596684.317220:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964790528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596684.648091:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596684.648398:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944835840 00000100:00100000:0.0:1789596684.648409:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944835840 00000100:00100000:0.0:1789596684.648609:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 52 00000100:00100000:0.0:1789596684.648620:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2352:x1876527944835840:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596684.648698:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2352:x1876527944835840:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 80us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596684.648706:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 52 00000100:00080000:1.0:1789596684.650377:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596684.650862:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596684.650930:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944835712 00000100:00100000:3.0:1789596684.650941:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944835712 00000100:00100000:3.0:1789596684.651014:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 202 00000100:00100000:3.0:1789596684.651024:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2351:x1876527944835712:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596684.651093:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2351:x1876527944835712:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 70us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596684.651101:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 202 00000100:00100000:3.0:1789596684.828227:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964790656:0@lo:400:kworker.0 00000100:00100000:0.0:1789596684.828273:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964791040:0@lo:400:kworker.0 00000100:00100000:3.0:1789596684.828312:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596684.828312:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596684.829938:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964791168:0@lo:400:kworker.0 00000100:00100000:3.0:1789596684.830003:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596684.830531:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964791168 00000100:00100000:2.0:1789596684.830541:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964791168 00000100:00100000:2.0:1789596684.830599:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789596684.830608:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964791168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596684.830667:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964791168:12345-0@lo:400:kworker.0 Request processed in 61us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596684.830684:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789596684.830724:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8ff38b100 x1876527964791168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596684.830749:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964791168:0@lo:400:kworker.0 00000100:00080000:3.0:1789596684.834545:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789596684.834923:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964791040 00000100:00100000:3.0:1789596684.834934:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964791040 00000100:00100000:3.0:1789596684.835023:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789596684.835033:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964791040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596684.835039:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964790656 00000100:00100000:0.0:1789596684.835044:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964790656 00000100:00100000:0.0:1789596684.835067:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789596684.835073:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3307:x1876527964790656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596684.835108:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964791040:12345-0@lo:400:kworker.0 Request processed in 78us (6796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596684.835108:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3307:x1876527964790656:12345-0@lo:400:kworker.0 Request processed in 35us (6796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596684.835116:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789596684.835127:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789596684.835152:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964790912:0@lo:400:kworker.0 00000100:00100000:0.0:1789596684.835164:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964791040:0@lo:400:kworker.0 00000100:00100000:3.0:1789596684.835183:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596684.835207:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964790912 00000100:00100000:3.0:1789596684.835216:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596684.835221:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964790912 00000100:00100000:3.0:1789596684.835223:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876527964790784:0@lo:400:kworker.0 00000100:00100000:0.0:1789596684.835255:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789596684.835261:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964790912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596684.835290:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964790912:12345-0@lo:400:kworker.0 Request processed in 29us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596684.835295:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789596684.835299:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596684.835306:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964790784 00000100:00100000:0.0:1789596684.835309:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964790784 00000100:00100000:0.0:1789596684.835322:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789596684.835323:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964790912:0@lo:400:kworker.0 00000100:00100000:0.0:1789596684.835327:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876527964790784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596684.835361:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876527964790784:12345-0@lo:400:kworker.0 Request processed in 33us (60us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596684.835367:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789596684.835368:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876527964790784:0@lo:400:kworker.0 00000100:00100000:2.0:1789596684.835437:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964790656:0@lo:400:kworker.0 00000100:00080000:2.0:1789596684.835454:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789596685.085954:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596685.341611:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789596685.341647:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964791296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596685.341743:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596685.342522:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964791296 00000100:00100000:0.0:1789596685.342535:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964791296 00000100:00100000:0.0:1789596685.342720:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789596685.342732:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964791296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596685.342782:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596685.342895:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964791296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596685.342902:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789596685.343440:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8ff38aa00 x1876527964791296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596685.343475:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964791296:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789596686.122592:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596687.136511:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596688.155290:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596689.181503:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596689.436558:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964791424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596689.436636:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596689.436776:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964791424 00000100:00100000:0.0:1789596689.436786:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964791424 00000100:00100000:0.0:1789596689.436881:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789596689.436890:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964791424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789596689.436925:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596689.436984:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964791424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596689.436991:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789596689.437035:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8f67c4e00 x1876527964791424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596689.437054:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964791424:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789596689.437729:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596689.766329:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596689.766384:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596689.766471:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944835968 00000100:00100000:2.0:1789596689.766482:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944835968 00000100:00100000:2.0:1789596689.766546:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 204 00000100:00100000:2.0:1789596689.766558:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2351:x1876527944835968:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596689.766650:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2351:x1876527944835968:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 94us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596689.766658:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 204 00000100:00100000:3.0:1789596689.772306:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944836096 00000100:00100000:3.0:1789596689.772327:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944836096 00000100:00100000:3.0:1789596689.772494:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 56 00000100:00100000:3.0:1789596689.772507:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff38aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2351:x1876527944836096:12345-192.168.202.44@tcp:400:kworker.0 00000100:00080000:1.0:1789596689.772701:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596689.773960:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff38aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2351:x1876527944836096:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 1445us (7563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596689.773974:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 56 00000100:00100000:2.0:1789596689.948436:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964791936:0@lo:400:kworker.0 00000100:00100000:2.0:1789596689.948510:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596689.948579:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789596689.948586:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964791808:0@lo:400:kworker.0 00000100:00100000:2.0:1789596689.948609:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596689.948642:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964791936 00000100:00100000:2.0:1789596689.948650:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964791936 00000100:00100000:2.0:1789596689.948695:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964791808 00000100:00100000:2.0:1789596689.948704:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964791808 00000100:00100000:2.0:1789596689.948724:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789596689.948732:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964791936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596689.948800:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964791936:12345-0@lo:400:kworker.0 Request processed in 60us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596689.948807:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789596689.948846:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789596689.948853:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964791808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596689.948881:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964791808:12345-0@lo:400:kworker.0 Request processed in 29us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596689.948886:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789596689.948922:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964791808:0@lo:400:kworker.0 00000100:00100000:2.0:1789596689.948933:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964791936:0@lo:400:kworker.0 00000100:00100000:0.0:1789596689.949007:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964791552:0@lo:400:kworker.0 00000100:00100000:0.0:1789596689.949041:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596689.949081:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964792064:0@lo:400:kworker.0 00000100:00100000:0.0:1789596689.949104:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596689.949123:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596689.949128:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964791680:0@lo:400:kworker.0 00000100:00100000:0.0:1789596689.949146:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596689.949167:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964792064 00000100:00100000:0.0:1789596689.949170:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964792064 00000100:00100000:0.0:1789596689.949207:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789596689.949213:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964792064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596689.949245:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff38ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964792064:12345-0@lo:400:kworker.0 Request processed in 32us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596689.949250:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789596689.949277:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8d0e8ed80 x1876527964792064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596689.949288:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964792064:0@lo:400:kworker.0 00000100:00080000:1.0:1789596689.949441:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789596689.949447:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596689.949680:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964791680 00000100:00100000:3.0:1789596689.949684:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964791680 00000100:00100000:3.0:1789596689.949719:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789596689.949726:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff38a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964791680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596689.949779:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff38a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964791680:12345-0@lo:400:kworker.0 Request processed in 53us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596689.949795:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789596689.949948:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964791680:0@lo:400:kworker.0 00000100:00100000:2.0:1789596689.950012:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964791552 00000100:00100000:2.0:1789596689.950016:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964791552 00000100:00100000:2.0:1789596689.950049:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789596689.950198:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964791552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596689.950281:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964791552:12345-0@lo:400:kworker.0 Request processed in 94us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596689.950288:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789596689.954700:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964791552:0@lo:400:kworker.0 00010000:00010000:1.0:1789596690.203157:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596690.459503:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596690.459524:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964792192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596690.459590:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596690.460337:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964792192 00000100:00100000:0.0:1789596690.460347:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964792192 00000100:00100000:0.0:1789596690.460397:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789596690.460408:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964792192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596690.460450:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596690.460505:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964792192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596690.460512:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789596690.460958:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8ff38a300 x1876527964792192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596690.460989:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964792192:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789596691.227110:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789596692.140812:0:10131:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 18:11:30 (1789596690) === 00010000:00010000:3.0:1789596692.252085:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596692.636416:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596692.636771:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944836224 00000100:00100000:2.0:1789596692.636783:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944836224 00000100:00100000:2.0:1789596692.636870:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 206 00000100:00100000:2.0:1789596692.636882:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:8135:x1876527944836224:12345-192.168.202.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789596692.636901:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596692.636920:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d79f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344c9e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596692.636951:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d79f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c9e expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596692.636964:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d79f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c9e expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596692.636974:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427c00, rc 0) 00000100:00100000:2.0:1789596692.637052:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+11:8135:x1876527944836224:12345-192.168.202.44@tcp:101:mount.lustre.0 Request processed in 172us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596692.637058:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 206 00000100:00100000:2.0:1789596692.646717:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596692.646860:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944836352 00000100:00100000:3.0:1789596692.646872:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944836352 00000100:00100000:3.0:1789596692.646929:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 207 00000100:00100000:3.0:1789596692.646940:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+11:8135:x1876527944836352:12345-192.168.202.44@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789596692.647301:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+11:8135:x1876527944836352:12345-192.168.202.44@tcp:501:mount.lustre.0 Request processed in 362us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596692.647308:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 207 00000100:00100000:3.0:1789596692.651006:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596692.651515:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944836480 00000100:00100000:0.0:1789596692.651531:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944836480 00000100:00100000:0.0:1789596692.651626:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 208 00000100:00100000:0.0:1789596692.651637:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+11:8135:x1876527944836480:12345-192.168.202.44@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789596692.651931:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+11:8135:x1876527944836480:12345-192.168.202.44@tcp:503:mount.lustre.0 Request processed in 295us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596692.651939:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 208 00000100:00100000:0.0:1789596692.655664:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596692.655806:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944836608 00000100:00100000:2.0:1789596692.655852:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944836608 00000100:00100000:2.0:1789596692.655897:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 209 00000100:00100000:2.0:1789596692.655905:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+11:8138:x1876527944836608:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789596692.656182:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+11:8138:x1876527944836608:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 277us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596692.656199:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 209 00000100:00100000:2.0:1789596692.698389:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596692.698513:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944836736 00000100:00100000:3.0:1789596692.698553:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944836736 00000100:00100000:3.0:1789596692.698644:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 210 00000100:00100000:3.0:1789596692.698658:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+11:8138:x1876527944836736:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789596692.699118:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+11:8138:x1876527944836736:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 462us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596692.699128:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 210 00000100:00100000:3.0:1789596692.711548:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596692.711798:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944836864 00000100:00100000:0.0:1789596692.711812:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944836864 00000100:00100000:0.0:1789596692.711913:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 211 00000100:00100000:0.0:1789596692.711926:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+11:8135:x1876527944836864:12345-192.168.202.44@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789596692.711949:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596692.711974:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d79fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344cc8 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596692.712029:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d79fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344cc8 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596692.712064:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d79fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344cc8 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596692.712089:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0031a00, rc 0) 00000100:00100000:0.0:1789596692.712195:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:8135:x1876527944836864:12345-192.168.202.44@tcp:101:mount.lustre.0 Request processed in 272us (2454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596692.712203:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 211 00000100:00100000:1.0:1789596692.718690:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596692.719198:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944836992 00000100:00100000:2.0:1789596692.719212:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944836992 00000100:00100000:2.0:1789596692.719284:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 212 00000100:00100000:2.0:1789596692.719296:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:8135:x1876527944836992:12345-192.168.202.44@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789596692.719334:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789596692.719374:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789596692.719379:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789596692.719383:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789596692.719385:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789596692.721276:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:8135:x1876527944836992:12345-192.168.202.44@tcp:256:mount.lustre.0 Request processed in 1968us (2587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596692.721290:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 212 00000100:00100000:3.0:1789596692.725010:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596692.729138:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944837120 00000100:00100000:2.0:1789596692.729169:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944837120 00000100:00100000:2.0:1789596692.729258:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 213 00000100:00100000:2.0:1789596692.729271:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:8135:x1876527944837120:12345-192.168.202.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789596692.729293:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596692.729319:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8ef426400/0x8973ae90b38d7a05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344ccf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596692.729367:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ef426400/0x8973ae90b38d7a05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ccf expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596692.729382:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8ef426400/0x8973ae90b38d7a05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ccf expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596692.729393:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426400, rc 0) 00000100:00100000:2.0:1789596692.729486:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:8135:x1876527944837120:12345-192.168.202.44@tcp:101:mount.lustre.0 Request processed in 217us (4491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596692.729511:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 213 00000100:00100000:1.0:1789596692.754872:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596692.755073:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944837248 00000100:00100000:0.0:1789596692.755090:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944837248 00000100:00100000:0.0:1789596692.755172:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 214 00000100:00100000:0.0:1789596692.755186:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:8135:x1876527944837248:12345-192.168.202.44@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789596692.755594:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:8135:x1876527944837248:12345-192.168.202.44@tcp:501:mount.lustre.0 Request processed in 408us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596692.755610:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 214 00000100:00100000:1.0:1789596692.760639:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596692.760871:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944837376 00000100:00100000:0.0:1789596692.760886:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944837376 00000100:00100000:0.0:1789596692.760963:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 215 00000100:00100000:0.0:1789596692.760975:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:8135:x1876527944837376:12345-192.168.202.44@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789596692.761310:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:8135:x1876527944837376:12345-192.168.202.44@tcp:503:mount.lustre.0 Request processed in 336us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596692.761321:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 215 00000100:00100000:3.0:1789596692.769210:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596692.780510:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944837504 00000100:00100000:2.0:1789596692.780533:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944837504 00000100:00100000:2.0:1789596692.780632:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 216 00000100:00100000:2.0:1789596692.780646:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:8142:x1876527944837504:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789596692.781259:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:8142:x1876527944837504:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 613us (12062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596692.781269:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 216 00000100:00100000:1.0:1789596692.784543:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596692.786929:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944837632 00000100:00100000:0.0:1789596692.786954:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944837632 00000100:00100000:0.0:1789596692.787057:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 217 00000100:00100000:0.0:1789596692.787071:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:8142:x1876527944837632:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789596692.787436:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:8142:x1876527944837632:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 367us (2907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596692.787446:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 217 00000100:00100000:1.0:1789596692.809666:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596692.809719:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596692.809890:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944838144 00000100:00100000:3.0:1789596692.809916:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944838144 00000100:00100000:3.0:1789596692.810012:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944837760 00000100:00100000:3.0:1789596692.810016:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944837760 00000100:00100000:3.0:1789596692.810034:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 60 00000100:00100000:3.0:1789596692.810046:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2353:x1876527944838144:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596692.810156:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2353:x1876527944838144:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 112us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596692.810183:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 60 00000100:00100000:3.0:1789596692.810204:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 10 00000100:00100000:3.0:1789596692.810209:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2350:x1876527944837760:12345-192.168.202.44@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789596692.810239:0:5842:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3@192.168.202.44@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:3.0:1789596692.810287:0:5842:0:(genops.c:1384:class_connect()) connect: client aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3, cookie 0x8973ae90b38d7a0c 00000004:00100000:3.0:1789596692.810332:0:5842:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789596692.810680:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9ea8f6594000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789596692.810721:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+6:2350:x1876527944837760:12345-192.168.202.44@tcp:38:mount.lustre.0 Request processed in 509us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596692.810749:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 10 00000100:00080000:1.0:1789596692.811328:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596692.822742:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596692.822941:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944838016 00000100:00100000:0.0:1789596692.822955:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944838016 00000100:00100000:0.0:1789596692.823054:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 11 00000100:00100000:0.0:1789596692.823067:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+6:8135:x1876527944838016:12345-192.168.202.44@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789596692.823137:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789596692.823267:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+6:8135:x1876527944838016:12345-192.168.202.44@tcp:41:mount.lustre.0 Request processed in 202us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596692.823277:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 11 00000100:00080000:1.0:1789596692.825013:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596692.839678:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596692.839810:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596692.840252:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944838272 00000100:00100000:0.0:1789596692.840268:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944838272 00000100:00100000:0.0:1789596692.840342:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944837888 00000100:00100000:0.0:1789596692.840346:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944837888 00000100:00100000:0.0:1789596692.840370:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 12 00000100:00100000:0.0:1789596692.840382:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+7:8135:x1876527944838272:12345-192.168.202.44@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789596692.840505:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+7:8135:x1876527944838272:12345-192.168.202.44@tcp:40:mount.lustre.0 Request processed in 124us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596692.840513:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 12 00000100:00100000:0.0:1789596692.840536:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 13 00000100:00100000:0.0:1789596692.840542:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+6:0:x1876527944837888:12345-192.168.202.44@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789596692.840575:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789596692.840621:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+6:0:x1876527944837888:12345-192.168.202.44@tcp:41:mount.lustre.0 Request processed in 79us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596692.840627:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 13 00000100:00100000:1.0:1789596692.849409:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596692.849459:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596692.849497:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596692.849608:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944838656 00000100:00100000:2.0:1789596692.849623:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944838656 00000100:00100000:2.0:1789596692.849705:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1 00000100:00100000:2.0:1789596692.849923:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+6:8135:x1876527944838656:12345-192.168.202.44@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789596692.850029:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789596692.850155:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+6:8135:x1876527944838656:12345-192.168.202.44@tcp:33:mount.lustre.0 Request processed in 237us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596692.850175:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1 00000100:00100000:3.0:1789596692.855257:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944838400 00000100:00100000:3.0:1789596692.855278:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944838400 00000100:00100000:3.0:1789596692.855345:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944838528 00000100:00100000:3.0:1789596692.855348:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944838528 00000100:00100000:3.0:1789596692.855384:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 12 00000100:00100000:3.0:1789596692.855402:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1876527944838400:12345-192.168.202.44@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789596692.855443:0:6695:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3@192.168.202.44@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:3.0:1789596692.855481:0:6695:0:(genops.c:1384:class_connect()) connect: client aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3, cookie 0x8973ae90b38d7a13 00002000:00100000:3.0:1789596692.855497:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3/ffff9ea8f6590800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789596692.855530:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789596692.856518:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789596692.856730:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9ea8f6597800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596692.858254:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 13 00000100:00100000:0.0:1789596692.858269:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1876527944838528:12345-192.168.202.44@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789596692.858317:0:6693:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3@192.168.202.44@tcp t0 exp 0000000000000000 cur 277 last 0 00000020:00000080:0.0:1789596692.858367:0:6693:0:(genops.c:1384:class_connect()) connect: client aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3, cookie 0x8973ae90b38d7a1a 00002000:00100000:0.0:1789596692.858385:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3/ffff9ea8c34f1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789596692.858417:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789596692.858693:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789596692.858734:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9ea8c34f5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596692.858804:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+6:2350:x1876527944838528:12345-192.168.202.44@tcp:8:mount.lustre.0 Request processed in 535us (9304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596692.858813:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 13 00000100:00100000:3.0:1789596692.859378:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+6:2350:x1876527944838400:12345-192.168.202.44@tcp:8:mount.lustre.0 Request processed in 1488us (7422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596692.859388:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 12 00000001:00100000:2.0:1789596693.125397:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3 00010000:00010000:1.0:1789596693.275398:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789596693.571849:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3 00010000:00010000:0.0:1789596694.300632:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596694.556003:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596694.556024:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964792320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596694.556411:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596694.556493:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964792320 00000100:00100000:3.0:1789596694.556502:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964792320 00000100:00100000:3.0:1789596694.556556:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789596694.556566:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964792320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596694.556601:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596694.556644:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964792320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596694.556651:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1789596694.561322:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789596694.561504:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8ff38b100 x1876527964792320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596694.561530:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964792320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596695.070306:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964792576:0@lo:400:kworker.0 00000100:00100000:2.0:1789596695.070374:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.070419:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964793088:0@lo:400:kworker.0 00000100:00100000:2.0:1789596695.070442:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.070469:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596695.070475:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964792704:0@lo:400:kworker.0 00000100:00100000:2.0:1789596695.070503:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596695.070531:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964792576 00000100:00100000:2.0:1789596695.070538:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964792576 00000100:00100000:2.0:1789596695.070578:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964792704 00000100:00100000:2.0:1789596695.070581:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964792704 00000100:00100000:2.0:1789596695.070607:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789596695.070615:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964792576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596695.070664:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964792576:12345-0@lo:400:kworker.0 Request processed in 49us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596695.070670:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789596695.070687:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789596695.070693:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964792704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596695.070837:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964793088 00000100:00100000:0.0:1789596695.070841:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964793088 00000100:00100000:0.0:1789596695.070884:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789596695.070891:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964793088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596695.072164:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964792448:0@lo:400:kworker.0 00000100:00100000:0.0:1789596695.072498:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964793088:12345-0@lo:400:kworker.0 Request processed in 1606us (2053us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.072516:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789596695.072609:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964792704:12345-0@lo:400:kworker.0 Request processed in 1915us (2104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596695.072618:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789596695.072639:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789596695.072644:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596695.072678:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964792704:0@lo:400:kworker.0 00000100:00100000:2.0:1789596695.072690:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964792576:0@lo:400:kworker.0 00010000:00080000:2.0:1789596695.072703:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8d0e8c000 x1876527964793088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596695.072777:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964793088:0@lo:400:kworker.0 00000100:00100000:2.0:1789596695.073076:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964792832:0@lo:400:kworker.0 00000100:00100000:2.0:1789596695.073113:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596695.073849:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596695.074089:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964792960:0@lo:400:kworker.0 00000100:00100000:3.0:1789596695.074122:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.074854:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964792832 00000100:00100000:0.0:1789596695.074864:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964792832 00000100:00100000:0.0:1789596695.075148:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789596695.075160:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964792832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596695.075233:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964792832:12345-0@lo:400:kworker.0 Request processed in 75us (2119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.075239:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789596695.075267:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964792960 00000100:00100000:0.0:1789596695.075272:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964792960 00000100:00100000:0.0:1789596695.075310:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789596695.075316:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964792960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596695.075352:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964792960:12345-0@lo:400:kworker.0 Request processed in 36us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.075358:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789596695.075395:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964792960:0@lo:400:kworker.0 00000100:00080000:0.0:1789596695.075416:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789596695.075434:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8d0e8dc00 x1876527964792832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596695.075444:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964792832:0@lo:400:kworker.0 00000100:00100000:3.0:1789596695.080843:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964792448 00000100:00100000:3.0:1789596695.080856:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964792448 00000100:00100000:3.0:1789596695.082257:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789596695.082274:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3309:x1876527964792448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596695.089796:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3309:x1876527964792448:12345-0@lo:400:kworker.0 Request processed in 7517us (15938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596695.089831:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789596695.091287:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964792448:0@lo:400:kworker.0 00010000:00010000:3.0:1789596695.323073:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596695.581146:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596695.581171:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964793216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596695.581246:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596695.581320:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964793216 00000100:00100000:0.0:1789596695.581332:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964793216 00000100:00100000:0.0:1789596695.581395:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789596695.581404:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff38a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964793216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596695.581438:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596695.581481:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff38a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964793216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596695.581487:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789596695.581525:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8ff38b100 x1876527964793216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596695.581543:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964793216:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1789596696.155707:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3 00010000:00010000:1.0:1789596696.347524:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596697.371287:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596697.959375:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596697.959420:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596697.959461:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596697.959493:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596697.959643:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944839168 00000100:00100000:0.0:1789596697.959654:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944839168 00000100:00100000:0.0:1789596697.959715:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 28 00000100:00100000:0.0:1789596697.959728:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2354:x1876527944839168:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596697.959802:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2354:x1876527944839168:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 77us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596697.959810:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 28 00000100:00100000:0.0:1789596697.959874:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944838912 00000100:00100000:0.0:1789596697.959879:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944838912 00000100:00100000:0.0:1789596697.959904:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944839040 00000100:00100000:0.0:1789596697.959906:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944839040 00000100:00100000:0.0:1789596697.959924:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 64 00000100:00100000:0.0:1789596697.959930:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2354:x1876527944838912:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596697.959959:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2354:x1876527944838912:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 29us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596697.959979:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 64 00000100:00100000:0.0:1789596697.959992:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 65 00000100:00100000:0.0:1789596697.959998:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2354:x1876527944839040:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596697.960024:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2354:x1876527944839040:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 26us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596697.960029:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 65 00000100:00080000:0.0:1789596697.960059:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596697.960064:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596697.960494:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596697.960703:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944838784 00000100:00100000:3.0:1789596697.960709:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944838784 00000100:00100000:3.0:1789596697.960753:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 219 00000100:00100000:3.0:1789596697.960760:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2354:x1876527944838784:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596697.960804:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2354:x1876527944838784:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 44us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596697.960811:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 219 00000100:00100000:0.0:1789596697.961378:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944839296 00000100:00100000:0.0:1789596697.961385:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944839296 00000100:00100000:0.0:1789596697.961440:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 29 00000100:00100000:0.0:1789596697.961448:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2354:x1876527944839296:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596697.961491:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2354:x1876527944839296:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 44us (1973us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596697.961498:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 29 00000100:00080000:2.0:1789596697.961608:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789596698.396154:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789596698.827978:0:10329:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg244-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1789596699.419472:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596699.677366:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964793344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596699.677438:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596699.690447:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964793344 00000100:00100000:3.0:1789596699.690467:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964793344 00000100:00100000:3.0:1789596699.692104:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789596699.692118:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964793344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596699.692175:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596699.692261:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964793344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (14821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596699.692269:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1789596699.692387:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789596699.693086:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8ff38b100 x1876527964793344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596699.693116:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964793344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596700.188346:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964793600:0@lo:400:kworker.0 00000100:00100000:1.0:1789596700.188418:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596700.188470:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964794112:0@lo:400:kworker.0 00000100:00100000:1.0:1789596700.188493:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596700.188521:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596700.188532:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964793728:0@lo:400:kworker.0 00000100:00100000:1.0:1789596700.188567:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596700.188597:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964793600 00000100:00100000:1.0:1789596700.188605:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964793600 00000100:00100000:1.0:1789596700.188647:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964793728 00000100:00100000:1.0:1789596700.188649:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964793728 00000100:00100000:1.0:1789596700.188676:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789596700.188683:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964793600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596700.188734:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964793600:12345-0@lo:400:kworker.0 Request processed in 50us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596700.188741:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789596700.188758:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789596700.188764:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964793728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596700.188790:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964793728:12345-0@lo:400:kworker.0 Request processed in 27us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596700.188796:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789596700.188839:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964794112 00000100:00100000:1.0:1789596700.188843:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964794112 00000100:00100000:1.0:1789596700.188873:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789596700.188879:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964794112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596700.188908:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964794112:12345-0@lo:400:kworker.0 Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596700.188914:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1789596700.188934:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789596700.188939:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596700.189078:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964793856:0@lo:400:kworker.0 00000100:00100000:3.0:1789596700.189118:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596700.189146:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789596700.189152:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964793472:0@lo:400:kworker.0 00000100:00100000:3.0:1789596700.189178:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596700.189198:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964793984:0@lo:400:kworker.0 00000100:00100000:3.0:1789596700.189219:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596700.189247:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964793856 00000100:00100000:3.0:1789596700.189251:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964793856 00000100:00100000:3.0:1789596700.189278:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789596700.189284:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964793856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596700.189318:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964793856:12345-0@lo:400:kworker.0 Request processed in 34us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596700.189325:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789596700.189342:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964793472 00000100:00100000:3.0:1789596700.189346:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964793472 00000100:00100000:3.0:1789596700.189369:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789596700.189375:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964793472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596700.189403:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964793472:12345-0@lo:400:kworker.0 Request processed in 28us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596700.189409:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789596700.189448:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964793472:0@lo:400:kworker.0 00010000:00080000:3.0:1789596700.189470:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8f67c4700 x1876527964793856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596700.189482:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964793856:0@lo:400:kworker.0 00000100:00100000:3.0:1789596700.189507:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964793984 00000100:00100000:3.0:1789596700.189511:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964793984 00000100:00100000:3.0:1789596700.189539:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789596700.189545:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876527964793984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596700.189577:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876527964793984:12345-0@lo:400:kworker.0 Request processed in 32us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596700.189582:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1789596700.189596:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596700.189611:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964793984:0@lo:400:kworker.0 00000100:00100000:1.0:1789596700.190118:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964793728:0@lo:400:kworker.0 00000100:00100000:1.0:1789596700.190140:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964793600:0@lo:400:kworker.0 00010000:00080000:1.0:1789596700.190167:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c31e3b80 x1876527964794112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596700.190176:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964794112:0@lo:400:kworker.0 00010000:00010000:1.0:1789596700.443142:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596700.699873:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964794240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596700.699945:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596700.700164:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964794240 00000100:00100000:0.0:1789596700.700173:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964794240 00000100:00100000:0.0:1789596700.700237:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789596700.700249:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964794240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596700.700287:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1789596700.700467:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8ff38b100 x1876527964794240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596700.700486:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964794240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596700.700569:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964794240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596700.700577:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1789596701.471398:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596702.492016:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596703.084620:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596703.084662:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596703.084697:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596703.084719:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596703.084738:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596703.084769:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944839424 00000100:00100000:2.0:1789596703.084778:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944839424 00000100:00100000:2.0:1789596703.084849:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 221 00000100:00100000:2.0:1789596703.084859:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2353:x1876527944839424:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596703.084928:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2353:x1876527944839424:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 70us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596703.084935:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 221 00000100:00100000:2.0:1789596703.084969:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944839808 00000100:00100000:2.0:1789596703.084972:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944839808 00000100:00100000:2.0:1789596703.085008:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944839936 00000100:00100000:2.0:1789596703.085010:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944839936 00000100:00100000:2.0:1789596703.085029:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 32 00000100:00100000:2.0:1789596703.085035:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2353:x1876527944839808:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596703.085063:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2353:x1876527944839808:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 29us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596703.085085:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 32 00000100:00100000:2.0:1789596703.085099:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 33 00000100:00100000:2.0:1789596703.085106:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2353:x1876527944839936:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596703.085130:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2353:x1876527944839936:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596703.085154:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 33 00000100:00100000:3.0:1789596703.085803:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944839552 00000100:00100000:3.0:1789596703.085810:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944839552 00000100:00100000:3.0:1789596703.085874:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944839680 00000100:00100000:3.0:1789596703.085877:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944839680 00000100:00100000:3.0:1789596703.085898:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 69 00000100:00100000:3.0:1789596703.085905:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2353:x1876527944839552:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596703.085952:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2353:x1876527944839552:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 48us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596703.085967:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 69 00000100:00100000:3.0:1789596703.085983:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 70 00000100:00100000:3.0:1789596703.085989:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2353:x1876527944839680:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596703.086014:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2353:x1876527944839680:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 25us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596703.086018:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 70 00000100:00080000:3.0:1789596703.086041:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789596703.086045:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789596703.086047:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789596703.515150:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596704.549810:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596704.796458:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789596704.796483:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964794368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596704.796558:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596704.798477:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964794368 00000100:00100000:0.0:1789596704.798493:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964794368 00000100:00100000:0.0:1789596704.798584:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789596704.798596:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964794368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789596704.798639:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596704.798730:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964794368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (2172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596704.798737:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1789596704.798790:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8ff38b100 x1876527964794368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596704.798811:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff38b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964794368:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789596704.799938:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596705.307639:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964794496:0@lo:400:kworker.0 00000100:00100000:0.0:1789596705.307713:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596705.307788:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964795008:0@lo:400:kworker.0 00000100:00100000:0.0:1789596705.307846:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596705.307877:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596705.307883:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964794880:0@lo:400:kworker.0 00000100:00100000:0.0:1789596705.307923:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596705.307958:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964795008 00000100:00100000:0.0:1789596705.307966:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964795008 00000100:00100000:0.0:1789596705.308040:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789596705.308061:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff38b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964795008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596705.308121:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff38b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964795008:12345-0@lo:400:kworker.0 Request processed in 63us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596705.308144:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789596705.308169:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964794880 00000100:00100000:0.0:1789596705.308173:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964794880 00000100:00100000:0.0:1789596705.308211:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789596705.308218:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900467b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964794880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596705.308251:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900467b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964794880:12345-0@lo:400:kworker.0 Request processed in 33us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596705.308256:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789596705.308270:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789596705.308303:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8d0e8dc00 x1876527964794880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596705.308316:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964794880:0@lo:400:kworker.0 00000100:00100000:0.0:1789596705.308325:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964795008:0@lo:400:kworker.0 00000100:00100000:2.0:1789596705.308603:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964794496 00000100:00100000:2.0:1789596705.308607:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964794496 00000100:00100000:2.0:1789596705.308644:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789596705.308652:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3309:x1876527964794496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596705.308690:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3309:x1876527964794496:12345-0@lo:400:kworker.0 Request processed in 39us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596705.308696:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789596705.308913:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964794496:0@lo:400:kworker.0 00000100:00100000:1.0:1789596705.309000:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964794624:0@lo:400:kworker.0 00000100:00100000:1.0:1789596705.309033:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596705.309069:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964795136:0@lo:400:kworker.0 00000100:00100000:1.0:1789596705.309092:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596705.309116:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596705.309123:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964794752:0@lo:400:kworker.0 00000100:00100000:1.0:1789596705.309143:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596705.309171:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964794624 00000100:00100000:2.0:1789596705.309309:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964794752 00000100:00100000:2.0:1789596705.309314:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964794752 00000100:00100000:2.0:1789596705.309351:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789596705.309358:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964794752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596705.309397:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964794752:12345-0@lo:400:kworker.0 Request processed in 40us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596705.309402:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1789596705.309418:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596705.309456:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964794624 00000100:00100000:1.0:1789596705.309488:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789596705.309494:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964794624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596705.309525:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964794624:12345-0@lo:400:kworker.0 Request processed in 31us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596705.309530:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789596705.309559:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964794752:0@lo:400:kworker.0 00000100:00100000:1.0:1789596705.309569:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964794624:0@lo:400:kworker.0 00000100:00100000:0.0:1789596705.309647:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964795136 00000100:00100000:0.0:1789596705.309651:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964795136 00000100:00100000:0.0:1789596705.309691:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789596705.309698:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964795136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596705.309733:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964795136:12345-0@lo:400:kworker.0 Request processed in 36us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596705.309738:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1789596705.310137:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789596705.310161:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8d0e8df80 x1876527964795136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596705.310236:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964795136:0@lo:400:kworker.0 00010000:00010000:1.0:1789596705.563374:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596705.820254:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964795264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596705.820327:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596705.820395:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964795264 00000100:00100000:0.0:1789596705.820405:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964795264 00000100:00100000:0.0:1789596705.820461:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789596705.820469:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964795264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596705.820526:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596705.820586:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964795264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596705.820592:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1789596705.820682:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea900467100 x1876527964795264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596705.820702:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964795264:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789596706.587081:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596707.612423:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596708.200686:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596708.200731:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596708.201804:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944840064 00000100:00100000:3.0:1789596708.201856:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944840064 00000100:00100000:3.0:1789596708.201924:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 223 00000100:00100000:3.0:1789596708.201935:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2351:x1876527944840064:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596708.202197:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2351:x1876527944840064:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 263us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596708.202207:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 223 00000100:00100000:0.0:1789596708.202412:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944840192 00000100:00100000:0.0:1789596708.202417:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944840192 00000100:00100000:0.0:1789596708.202473:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 74 00000100:00100000:0.0:1789596708.202480:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2351:x1876527944840192:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596708.202512:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2351:x1876527944840192:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 33us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596708.202518:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 74 00000100:00080000:3.0:1789596708.203310:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596708.206458:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596708.206556:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596708.206703:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596708.206733:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944840448 00000100:00100000:1.0:1789596708.206743:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944840448 00000100:00100000:1.0:1789596708.206805:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944840576 00000100:00100000:1.0:1789596708.206809:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944840576 00000100:00100000:1.0:1789596708.206853:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 36 00000100:00100000:1.0:1789596708.206863:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2352:x1876527944840448:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596708.206929:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2352:x1876527944840448:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 67us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596708.206936:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 36 00000100:00100000:1.0:1789596708.206952:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 37 00000100:00100000:1.0:1789596708.206958:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2352:x1876527944840576:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596708.206983:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2352:x1876527944840576:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 25us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596708.207003:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 37 00000100:00080000:1.0:1789596708.207074:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789596708.207078:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596708.211276:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944840320 00000100:00100000:3.0:1789596708.211306:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944840320 00000100:00100000:3.0:1789596708.211389:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 75 00000100:00100000:3.0:1789596708.211399:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2352:x1876527944840320:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596708.211488:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2352:x1876527944840320:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 90us (4931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596708.211495:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 75 00000100:00080000:1.0:1789596708.211890:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789596708.651642:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596709.661100:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596709.916399:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900464380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964795392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596709.916482:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596709.916604:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964795392 00000100:00100000:1.0:1789596709.916630:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964795392 00000100:00100000:1.0:1789596709.916698:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789596709.916707:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964795392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789596709.916758:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789596709.917512:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964795392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 803us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596709.917521:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1789596709.917550:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789596709.918070:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea900464380 x1876527964795392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596709.918092:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900464380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964795392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596710.429213:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964795648:0@lo:400:kworker.0 00000100:00100000:1.0:1789596710.429288:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596710.429338:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964796160:0@lo:400:kworker.0 00000100:00100000:1.0:1789596710.429365:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596710.429396:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596710.429403:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964795776:0@lo:400:kworker.0 00000100:00100000:1.0:1789596710.429448:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596710.429485:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964796160 00000100:00100000:1.0:1789596710.429495:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964796160 00000100:00100000:1.0:1789596710.429557:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789596710.429565:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964796160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596710.429630:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964796160:12345-0@lo:400:kworker.0 Request processed in 65us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596710.429638:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789596710.429661:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789596710.429694:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c31e3100 x1876527964796160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596710.429707:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964796160:0@lo:400:kworker.0 00000100:00100000:2.0:1789596710.430577:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964795520:0@lo:400:kworker.0 00000100:00100000:2.0:1789596710.430621:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596710.430661:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964796032:0@lo:400:kworker.0 00000100:00100000:2.0:1789596710.430685:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596710.430705:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789596710.430711:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964795904:0@lo:400:kworker.0 00000100:00100000:2.0:1789596710.430759:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596710.430788:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964795648 00000100:00100000:2.0:1789596710.430793:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964795648 00000100:00100000:2.0:1789596710.430840:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964795776 00000100:00100000:2.0:1789596710.430844:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964795776 00000100:00100000:2.0:1789596710.430876:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964796032 00000100:00100000:2.0:1789596710.430879:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964796032 00000100:00100000:2.0:1789596710.430894:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789596710.430901:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964795648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596710.430946:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964795648:12345-0@lo:400:kworker.0 Request processed in 45us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596710.430952:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789596710.430964:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789596710.430970:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964795776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596710.430995:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964795776:12345-0@lo:400:kworker.0 Request processed in 25us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596710.431013:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789596710.431025:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789596710.431030:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964796032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596710.431061:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964796032:12345-0@lo:400:kworker.0 Request processed in 31us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596710.431067:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789596710.431086:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964795904 00000100:00100000:2.0:1789596710.431090:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964795904 00000100:00100000:2.0:1789596710.431111:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789596710.431117:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964795904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596710.431145:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964795904:12345-0@lo:400:kworker.0 Request processed in 28us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596710.431158:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1789596710.431187:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c31e3480 x1876527964795904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596710.431198:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964795904:0@lo:400:kworker.0 00000100:00100000:2.0:1789596710.431209:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964796032:0@lo:400:kworker.0 00000100:00080000:2.0:1789596710.431234:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596710.431251:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964795776:0@lo:400:kworker.0 00000100:00100000:2.0:1789596710.431261:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964795648:0@lo:400:kworker.0 00000100:00100000:1.0:1789596710.431882:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964795520 00000100:00100000:1.0:1789596710.431889:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964795520 00000100:00100000:1.0:1789596710.431925:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789596710.431933:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3309:x1876527964795520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596710.431982:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3309:x1876527964795520:12345-0@lo:400:kworker.0 Request processed in 50us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596710.431988:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789596710.433206:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964795520:0@lo:400:kworker.0 00010000:00010000:3.0:1789596710.688122:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596710.939129:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964796288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596710.939201:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596710.939317:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964796288 00000100:00100000:0.0:1789596710.939325:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964796288 00000100:00100000:0.0:1789596710.939381:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789596710.939392:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964796288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596710.939428:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596710.939476:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964796288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596710.939482:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1789596710.939519:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea900466d80 x1876527964796288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596710.939538:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964796288:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789596711.708925:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596712.752230:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596713.318555:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596713.318617:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596713.318653:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596713.318691:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944840832 00000100:00100000:1.0:1789596713.318710:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944840832 00000100:00100000:1.0:1789596713.318784:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944840960 00000100:00100000:1.0:1789596713.318788:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944840960 00000100:00100000:1.0:1789596713.318810:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 79 00000100:00100000:1.0:1789596713.318845:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2354:x1876527944840832:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596713.319043:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944840704 00000100:00100000:0.0:1789596713.319063:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944840704 00000100:00100000:0.0:1789596713.319096:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 225 00000100:00100000:0.0:1789596713.319104:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2354:x1876527944840704:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596713.319140:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2354:x1876527944840704:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 37us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596713.319149:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 225 00000100:00100000:0.0:1789596713.319215:0:5841:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789596713.319226:0:5841:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:0.0:1789596713.319244:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596713.319370:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 80 00000100:00100000:0.0:1789596713.319378:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2354:x1876527944840960:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596713.319406:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2354:x1876527944840960:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 29us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596713.319412:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 80 00000100:00100000:1.0:1789596713.319792:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2354:x1876527944840832:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 947us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596713.319801:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 79 00000100:00100000:1.0:1789596713.321455:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596713.323351:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944841088 00000100:00100000:3.0:1789596713.323370:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944841088 00000100:00100000:3.0:1789596713.323554:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 14 00000100:00100000:3.0:1789596713.323567:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2350:x1876527944841088:12345-192.168.202.44@tcp:9:kworker.0 00000020:00000080:3.0:1789596713.323607:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7a13 00000100:00080000:3.0:1789596713.323618:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9ea8f6597800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789596713.323668:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789596713.325062:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+2:2350:x1876527944841088:12345-192.168.202.44@tcp:9:kworker.0 Request processed in 1486us (3605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596713.325078:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 14 00010000:00010000:3.0:1789596713.325118:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789596713.325318:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596713.338362:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596713.339199:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944841216 00000100:00100000:3.0:1789596713.339217:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944841216 00000100:00100000:3.0:1789596713.339318:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 15 00000100:00100000:3.0:1789596713.339332:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2350:x1876527944841216:12345-192.168.202.44@tcp:9:kworker.0 00000020:00000080:3.0:1789596713.339372:0:6695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7a1a 00000100:00080000:3.0:1789596713.339385:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9ea8c34f5000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789596713.339435:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:0.0:1789596713.339630:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789596713.341147:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596713.342676:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+2:2350:x1876527944841216:12345-192.168.202.44@tcp:9:kworker.0 Request processed in 2376us (3355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596713.342693:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 15 00000001:00100000:2.0:1789596713.632428:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3 00000020:00000080:2.0:1789596713.632442:0:7655:0:(genops.c:885:class_export_put()) final put ffff9ea8c34f1000/aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3 00000020:00000080:2.0:1789596713.632476:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c34f1000/aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3 for lustre-OST0001 00000020:00000080:2.0:1789596713.635153:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea8c34f5000 for lustre-OST0001 00010000:00010000:1.0:1789596713.757860:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596714.782283:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596715.056234:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789596715.056267:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964796416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596715.056373:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596715.059204:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964796416 00000100:00100000:2.0:1789596715.059229:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964796416 00000100:00100000:2.0:1789596715.059315:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789596715.059327:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964796416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596715.059388:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789596715.059516:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964796416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 191us (3143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596715.059549:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1789596715.059610:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8d0e8f100 x1876527964796416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596715.059639:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964796416:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789596715.060101:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596715.552139:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964796672:0@lo:400:kworker.0 00000100:00100000:1.0:1789596715.552244:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596715.552346:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596715.552364:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964796800:0@lo:400:kworker.0 00000100:00100000:1.0:1789596715.552391:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596715.555059:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964796544:0@lo:400:kworker.0 00000100:00100000:2.0:1789596715.555150:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596715.555207:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964797056:0@lo:400:kworker.0 00000100:00100000:2.0:1789596715.555242:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596715.555277:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789596715.555285:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964796928:0@lo:400:kworker.0 00000100:00100000:2.0:1789596715.555312:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596715.555352:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964797056 00000100:00100000:2.0:1789596715.555363:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964797056 00000100:00100000:2.0:1789596715.555431:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789596715.555442:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964797056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596715.555509:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964797056:12345-0@lo:400:kworker.0 Request processed in 68us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596715.555516:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789596715.555746:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964796672 00000100:00100000:2.0:1789596715.555751:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964796672 00000100:00100000:2.0:1789596715.555776:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964796800 00000100:00100000:2.0:1789596715.555779:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964796800 00000100:00100000:2.0:1789596715.555794:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964796928 00000100:00100000:2.0:1789596715.555796:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964796928 00000100:00100000:2.0:1789596715.555809:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789596715.555839:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964796672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596715.555894:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964796672:12345-0@lo:400:kworker.0 Request processed in 78us (3651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596715.555900:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789596715.555912:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789596715.555918:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964796800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596715.555946:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964796800:12345-0@lo:400:kworker.0 Request processed in 28us (3554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596715.555964:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789596715.555977:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789596715.555983:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964796928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596715.556009:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964796928:12345-0@lo:400:kworker.0 Request processed in 27us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596715.556014:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789596715.556064:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964796800:0@lo:400:kworker.0 00000100:00100000:2.0:1789596715.556079:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964796672:0@lo:400:kworker.0 00000100:00100000:2.0:1789596715.556484:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964796928:0@lo:400:kworker.0 00010000:00080000:2.0:1789596715.556498:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8ff566a00 x1876527964797056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596715.556508:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964797056:0@lo:400:kworker.0 00000100:00080000:0.0:1789596715.557051:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789596715.557058:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789596715.565601:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964796544 00000100:00100000:3.0:1789596715.565626:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964796544 00000100:00100000:3.0:1789596715.566016:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789596715.566031:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3309:x1876527964796544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596715.566158:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3309:x1876527964796544:12345-0@lo:400:kworker.0 Request processed in 131us (11008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596715.566166:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789596715.566935:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964796544:0@lo:400:kworker.0 00010000:00010000:1.0:1789596715.803510:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596716.059145:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789596716.067353:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964797184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596716.067454:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596716.070099:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964797184 00000100:00100000:2.0:1789596716.070122:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964797184 00000100:00100000:2.0:1789596716.070353:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789596716.070390:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964797184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789596716.070451:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789596716.070648:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964797184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 262us (3192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596716.070656:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1789596716.070846:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea900466d80 x1876527964797184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596732 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596716.070875:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900466d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964797184:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1789596716.665878:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3 00000020:00000080:0.0:1789596716.665889:0:6719:0:(genops.c:885:class_export_put()) final put ffff9ea8f6590800/aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3 00000020:00000080:0.0:1789596716.665920:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8f6590800/aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3 for lustre-OST0000 00000020:00000080:0.0:1789596716.665982:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea8f6597800 for lustre-OST0000 00010000:00010000:3.0:1789596716.830313:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789596717.168812:0:11034:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789596717.851105:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596718.439193:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596718.439237:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596718.439264:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944841344 00000100:00100000:1.0:1789596718.439275:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596718.439302:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944841600 00000100:00100000:1.0:1789596718.439311:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944841600 00000100:00100000:1.0:1789596718.439384:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944841472 00000100:00100000:1.0:1789596718.439388:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944841472 00000100:00100000:2.0:1789596718.439397:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944841344 00000100:00100000:1.0:1789596718.439414:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 84 00000100:00100000:1.0:1789596718.439427:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2352:x1876527944841600:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596718.439438:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 227 00000100:00100000:2.0:1789596718.439448:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2352:x1876527944841344:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596718.439527:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2352:x1876527944841600:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 100us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596718.439528:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2352:x1876527944841344:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 77us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596718.439545:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 84 00000100:00100000:2.0:1789596718.439547:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 227 00000100:00100000:1.0:1789596718.439573:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 85 00000100:00100000:1.0:1789596718.439582:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2352:x1876527944841472:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596718.439609:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2352:x1876527944841472:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 29us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596718.439615:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 85 00000100:00080000:1.0:1789596718.439648:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789596718.875090:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596719.901558:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596720.155127:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596720.155151:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964797312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596720.155217:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596720.155749:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964797312 00000100:00100000:2.0:1789596720.155758:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964797312 00000100:00100000:2.0:1789596720.155858:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789596720.155879:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964797312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596720.155925:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789596720.155978:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964797312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596720.155985:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1789596720.156075:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8d0e8d180 x1876527964797312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596720.156126:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964797312:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789596720.156419:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596720.667155:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964797696:0@lo:400:kworker.0 00000100:00100000:1.0:1789596720.667225:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596720.667278:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596720.667284:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964797824:0@lo:400:kworker.0 00000100:00100000:1.0:1789596720.667307:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596720.667341:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964797696 00000100:00100000:1.0:1789596720.667350:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964797696 00000100:00100000:1.0:1789596720.667404:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964797824 00000100:00100000:1.0:1789596720.667407:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964797824 00000100:00100000:1.0:1789596720.667430:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789596720.667438:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964797696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596720.667490:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964797696:12345-0@lo:400:kworker.0 Request processed in 52us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596720.667497:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789596720.667513:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789596720.667520:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964797824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596720.667548:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964797824:12345-0@lo:400:kworker.0 Request processed in 29us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596720.667553:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1789596720.667572:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596720.667608:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff567100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964797824:0@lo:400:kworker.0 00000100:00100000:1.0:1789596720.667618:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964797696:0@lo:400:kworker.0 00000100:00100000:0.0:1789596720.667754:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964797440:0@lo:400:kworker.0 00000100:00100000:0.0:1789596720.667792:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596720.667858:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964797952:0@lo:400:kworker.0 00000100:00100000:0.0:1789596720.667884:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596720.667922:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596720.667928:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964797568:0@lo:400:kworker.0 00000100:00100000:0.0:1789596720.667951:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596720.668061:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964797440 00000100:00100000:1.0:1789596720.668066:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964797440 00000100:00100000:1.0:1789596720.668101:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789596720.668115:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964797440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596720.668154:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964797440:12345-0@lo:400:kworker.0 Request processed in 40us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596720.668160:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789596720.668189:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964797952 00000100:00100000:1.0:1789596720.668192:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964797952 00000100:00100000:1.0:1789596720.668223:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789596720.668231:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964797952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596720.668260:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900464e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964797952:12345-0@lo:400:kworker.0 Request processed in 31us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596720.668266:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789596720.668283:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789596720.668298:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964797440:0@lo:400:kworker.0 00010000:00080000:1.0:1789596720.668310:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8ff566a00 x1876527964797952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596720.668321:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964797952:0@lo:400:kworker.0 00000100:00100000:1.0:1789596720.668339:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964797568 00000100:00100000:1.0:1789596720.668342:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964797568 00000100:00100000:1.0:1789596720.668364:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789596720.668369:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964797568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596720.668402:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900466d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964797568:12345-0@lo:400:kworker.0 Request processed in 33us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596720.668407:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789596720.668433:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964797568:0@lo:400:kworker.0 00000020:00000080:1.0:1789596720.805024:0:11182:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff4ff5480 20000000:00000080:1.0:1789596720.805050:0:11182:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ea8fa55e800 uarg=0000000000000000 20000000:01000000:1.0:1789596720.805086:0:11182:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789596720.805091:0:11182:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789596720.805096:0:11182:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789596720.806360:0:11183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1789596720.806512:0:11182:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789596720.825145:0:11182:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789596720.825356:0:11182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d7a21 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.825379:0:11182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8d5f89200/0x8973ae90b38d79c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c97 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.825389:0:11182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea9021f8800/0x8973ae90b38d79d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d79cd expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.825408:0:11182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d79e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d79db expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.825415:0:11182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8ef427a00/0x8973ae90b38d79f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d79e9 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.825423:0:11182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8ef426400/0x8973ae90b38d7a05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ccf expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.825430:0:11182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d7a21 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.825469:0:11182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8ef426400/0x8973ae90b38d7a05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ccf expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.825483:0:11182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ea8ef426400/0x8973ae90b38d7a05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ccf expref: 12 pid: 5834 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596720.825498:0:11182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1876527964798080:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789596720.828708:0:11182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8ef427a00/0x8973ae90b38d79f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d79e9 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.828727:0:11182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea8ef427a00/0x8973ae90b38d79f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d79e9 expref: 18 pid: 5836 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596720.828743:0:11182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1876527964798208:0@lo:104: 00000100:00100000:2.0:1789596720.828841:0:11182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789596720.828881:0:11182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d79e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d79db expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.828912:0:11182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d79e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d79db expref: 18 pid: 5834 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596720.828923:0:11182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1876527964798336:0@lo:104: 00000100:00100000:2.0:1789596720.828947:0:11182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789596720.828980:0:11182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea9021f8800/0x8973ae90b38d79d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d79cd expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.828989:0:11182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea9021f8800/0x8973ae90b38d79d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d79cd expref: 18 pid: 5836 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596720.828997:0:11182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1876527964798464:0@lo:104: 00000100:00100000:2.0:1789596720.829019:0:11182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789596720.829046:0:11182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8d5f89200/0x8973ae90b38d79c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c97 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829056:0:11182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ea8d5f89200/0x8973ae90b38d79c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c97 expref: 12 pid: 5836 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596720.829065:0:11182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1876527964798592:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789596720.829103:0:11182:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f694a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789596720.829141:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964798208 00000100:00100000:2.0:1789596720.829148:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964798208 00000100:00100000:2.0:1789596720.829186:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964798336 00000100:00100000:2.0:1789596720.829189:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964798336 00000100:00100000:2.0:1789596720.829200:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964798464 00000100:00100000:2.0:1789596720.829202:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964798464 00000100:00100000:2.0:1789596720.829217:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789596720.829224:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+5:11182:x1876527964798208:12345-0@lo:104: 00010000:00010000:2.0:1789596720.829244:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d79e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d79f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829295:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789596720.829301:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+5:11182:x1876527964798208:12345-0@lo:104: Request processed in 77us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596720.829308:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789596720.829326:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789596720.829332:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+4:11182:x1876527964798336:12345-0@lo:104: 00010000:00010000:2.0:1789596720.829340:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d79db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d79e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829369:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789596720.829374:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+4:11182:x1876527964798336:12345-0@lo:104: Request processed in 43us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596720.829380:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789596720.829391:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789596720.829396:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:11182:x1876527964798464:12345-0@lo:104: 00010000:00010000:2.0:1789596720.829402:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d79cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d79d4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829426:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789596720.829431:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:11182:x1876527964798464:12345-0@lo:104: Request processed in 35us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596720.829436:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789596720.829465:0:11182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1876527964798208:0@lo:104: 00000100:00100000:2.0:1789596720.829473:0:11182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1876527964798336:0@lo:104: 00000100:00100000:2.0:1789596720.829486:0:11182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1876527964798464:0@lo:104: 00010000:00010000:2.0:1789596720.829506:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789596720.829511:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d79e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d79f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829519:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031000 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596720.829523:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d79e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d79f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829532:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d79e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d79f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596720.829540:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d79e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d79f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596720.829546:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789596720.829570:0:7643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d79e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d79f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829576:0:7643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596720.829592:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d79e9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d79f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829599:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d79e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d79f0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829610:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789596720.829613:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d79db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d79e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829618:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f9e00 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596720.829626:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d79db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d79e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829633:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d79db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d79e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596720.829640:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d79db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d79e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596720.829645:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789596720.829658:0:7643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d79db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d79e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829664:0:7643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596720.829674:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d79db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d79e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829681:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d79db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d79e2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829690:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596720.829693:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d79cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d79d4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829699:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426200 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596720.829702:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d79cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d79d4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829708:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d79cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d79d4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596720.829724:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d79cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d79d4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596720.829729:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789596720.829741:0:7643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d79cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d79d4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829746:0:7643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596720.829752:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d79cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d79d4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829758:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d79cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d79d4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829770:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596720.829771:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596720.829773:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596720.829792:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964798720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596720.829841:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596720.829869:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964798720 00000100:00100000:2.0:1789596720.829873:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964798720 00010000:00010000:2.0:1789596720.829890:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8ef427a00/0x8973ae90b38d79f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d79e9 expref: 19 pid: 5836 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596720.829926:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789596720.829933:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c8283c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3309:x1876527964798720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596720.829943:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596720.829948:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8ef427a00/0x8973ae90b38d79f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d79e9 expref: 19 pid: 5836 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829963:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8ef427a00/0x8973ae90b38d79f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d79e9 expref: 19 pid: 5836 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829976:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8ef427a00/0x8973ae90b38d79f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d79e9 expref: 19 pid: 5836 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.829988:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596720.830016:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c8283c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:3309:x1876527964798720:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596720.830022:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789596720.830070:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964798720:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596720.830093:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596720.830102:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596720.830351:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964798848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789596720.830381:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596720.830413:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596720.830418:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964798976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789596720.830435:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596720.830489:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964798848 00000100:00100000:0.0:1789596720.830494:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964798848 00010000:00010000:0.0:1789596720.830512:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d79e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d79db expref: 18 pid: 5834 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596720.830537:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964798976 00000100:00100000:0.0:1789596720.830540:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964798976 00010000:00010000:0.0:1789596720.830549:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea9021f8800/0x8973ae90b38d79d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d79cd expref: 19 pid: 5836 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596720.830565:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789596720.830571:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff565180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964798848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789596720.830579:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596720.830583:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d79e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d79db expref: 19 pid: 5834 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596720.830591:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d79e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d79db expref: 19 pid: 5834 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596720.830602:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d79e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d79db expref: 19 pid: 5834 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596720.830612:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596720.830639:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff565180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:3306:x1876527964798848:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596720.830645:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789596720.830658:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789596720.830672:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff566a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:3306:x1876527964798976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789596720.830679:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596720.830684:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea9021f8800/0x8973ae90b38d79d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d79cd expref: 17 pid: 5836 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596720.830692:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea9021f8800/0x8973ae90b38d79d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d79cd expref: 17 pid: 5836 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596720.830702:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea9021f8800/0x8973ae90b38d79d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d79cd expref: 17 pid: 5836 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596720.830712:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596720.830735:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff566a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:3306:x1876527964798976:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596720.830740:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789596720.830768:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964798976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789596720.830777:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964798848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596720.836963:0:11182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1876527964798080:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789596720.836980:0:11182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1876527964798592:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789596720.837014:0:11182:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d7a21 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596720.844062:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596720.844159:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596720.850492:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944841728 00000100:00100000:0.0:1789596720.850511:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944841728 00000100:00100000:2.0:1789596720.850593:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944841856 00000100:00100000:2.0:1789596720.850598:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944841856 00010000:00010000:2.0:1789596720.850644:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8d5f89200/0x8973ae90b38d79c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c97 expref: 14 pid: 5836 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596720.850790:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 28 00000100:00100000:2.0:1789596720.850799:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff564a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+14:2353:x1876527944841856:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596720.850840:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596720.850858:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8d5f89200/0x8973ae90b38d79c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c97 expref: 14 pid: 5836 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.850870:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8d5f89200/0x8973ae90b38d79c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c97 expref: 14 pid: 5836 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.850889:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f89200/0x8973ae90b38d79c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c97 expref: 14 pid: 5836 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596720.850913:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596720.850987:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff564a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2353:x1876527944841856:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 189us (6827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596720.850995:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 28 00010000:00010000:3.0:1789596720.854051:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8ef426400/0x8973ae90b38d7a05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ccf expref: 12 pid: 5834 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596720.854109:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 29 00000100:00100000:3.0:1789596720.854121:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff567800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:2354:x1876527944841728:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596720.854136:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596720.854142:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8ef426400/0x8973ae90b38d7a05 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ccf expref: 12 pid: 5834 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596720.854155:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8ef426400/0x8973ae90b38d7a05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ccf expref: 12 pid: 5834 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596720.854172:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8ef426400/0x8973ae90b38d7a05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ccf expref: 12 pid: 5834 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596720.854189:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d7a21 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596720.854198:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d7a21 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596720.854216:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d7a21 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596720.854223:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d7a21 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596720.854246:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d7a21 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596720.854253:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d7a21 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596720.854260:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426e00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:3.0:1789596720.854264:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d7a21 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596720.854273:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d7a21 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596720.863769:0:11182:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d7a21 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596720.863789:0:11182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d7a21 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596720.869809:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d7a21 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596720.869849:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d7a21 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596720.869874:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596720.869960:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff567800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+11:2354:x1876527944841728:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 15838us (25903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596720.869972:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 29 00010000:00010000:2.0:1789596720.924937:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596721.179136:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964799104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596721.179209:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596721.179410:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964799104 00000100:00100000:3.0:1789596721.179419:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964799104 00000100:00100000:3.0:1789596721.179463:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789596721.179472:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff567100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964799104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789596721.179507:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596721.179556:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff567100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964799104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596721.179576:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1789596721.180114:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea900465c00 x1876527964799104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596737 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596721.180143:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964799104:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789596721.949950:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789596722.017869:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789596722.017876:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea8f66d1800 from 7 10000000:01000000:2.0:1789596722.017880:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789596722.017939:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7a28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596722.017952:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7a28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596722.017964:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7a28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596722.017991:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5782680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964799232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789596722.018062:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596722.018101:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f694a900 going to sleep for 11 seconds 00000100:00100000:3.0:1789596722.021151:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964799232 00000100:00100000:3.0:1789596722.021167:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964799232 00000100:00100000:3.0:1789596722.021232:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789596722.021242:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:5838:x1876527964799232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596722.021271:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596722.021293:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f89600/0x8973ae90b38d7a2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d7a28 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596722.021321:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f89600/0x8973ae90b38d7a2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d7a28 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596722.021332:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f89600/0x8973ae90b38d7a2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7a28 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596722.021341:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89600, rc 0) 00000100:00100000:3.0:1789596722.021426:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964799232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (3363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596722.021433:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789596722.021812:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5782680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964799232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596722.021858:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7a28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7a2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596722.021867:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7a28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7a2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596722.021961:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff567b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964799360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596722.022014:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596722.022051:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c60e3780 going to sleep for 11 seconds 00000100:00100000:3.0:1789596722.022111:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964799360 00000100:00100000:3.0:1789596722.022116:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964799360 00000100:00100000:3.0:1789596722.022150:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789596722.022157:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964799360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596722.022394:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964799360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596722.022401:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789596722.024527:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff567b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964799360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596722.024595:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff567b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964799488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596722.024674:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596722.024718:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c60e3780 going to sleep for 11 seconds 00000100:00100000:1.0:1789596722.024741:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964799488 00000100:00100000:1.0:1789596722.024747:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964799488 00000100:00100000:1.0:1789596722.024804:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789596722.024840:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964799488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596722.025049:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964799488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 236us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596722.025057:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789596722.025111:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff567b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964799488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789596722.030867:0:11202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789596722.033318:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789596722.033355:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789596722.033368:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7a28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7a2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596722.033383:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7a28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7a2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596722.033396:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789596722.033399:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea8f9e94000 from 7 10000000:01000000:1.0:1789596722.033401:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789596722.033445:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7a36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596722.033468:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7a36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596722.033480:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7a36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596722.033506:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff567b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964799616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789596722.033581:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596722.033650:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c60e3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789596722.033875:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964799616 00000100:00100000:3.0:1789596722.033889:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964799616 00000100:00100000:3.0:1789596722.033949:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789596722.033957:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964799616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596722.033970:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596722.033983:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d7a3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d7a36 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596722.034004:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d7a3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d7a36 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596722.034014:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d7a3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7a36 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596722.034022:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88600, rc 0) 00000100:00100000:3.0:1789596722.034066:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964799616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596722.034073:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789596722.034127:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff567b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964799616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596722.034141:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7a36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7a3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596722.034151:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7a36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7a3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596722.034209:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c310ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964799744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596722.034234:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596722.034250:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c313ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596722.034264:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964799744 00000100:00100000:3.0:1789596722.034273:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964799744 00000100:00100000:3.0:1789596722.034296:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789596722.034303:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964799744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596722.034566:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964799744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596722.034573:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789596722.034644:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c310ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964799744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596722.034672:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff567480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964799872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596722.034710:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596722.034739:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c60e3840 going to sleep for 11 seconds 00000100:00100000:3.0:1789596722.035558:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964799872 00000100:00100000:3.0:1789596722.035566:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964799872 00000100:00100000:3.0:1789596722.035611:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789596722.035619:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964799872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789596722.035881:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964799872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 261us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596722.035889:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789596722.041147:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff567480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964799872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789596722.042781:0:11203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789596722.042995:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789596722.043017:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789596722.043029:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7a36 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7a3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596722.043040:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7a36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7a3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596722.043051:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789596722.043054:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea8e4942800 from 7 10000000:01000000:3.0:1789596722.043057:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789596722.043098:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88c00/0x8973ae90b38d7a44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596722.043106:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88c00/0x8973ae90b38d7a44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596722.043134:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88c00/0x8973ae90b38d7a44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596722.043158:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c310d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964800000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789596722.043229:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596722.043291:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c313ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596722.043912:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964800000 00000100:00100000:0.0:1789596722.043921:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964800000 00000100:00100000:0.0:1789596722.043983:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789596722.043991:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964800000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596722.044005:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596722.044019:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d7a4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d7a44 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596722.044043:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d7a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d7a44 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596722.044054:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d7a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7a44 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596722.044062:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030800, rc 0) 00000100:00100000:0.0:1789596722.044109:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964800000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596722.044116:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789596722.044161:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c310d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964800000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596722.044175:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88c00/0x8973ae90b38d7a44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7a4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596722.044184:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88c00/0x8973ae90b38d7a44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7a4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596722.044237:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900465500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964800128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596722.044455:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596722.044494:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6948e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789596722.044946:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964800128 00000100:00100000:1.0:1789596722.044952:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964800128 00000100:00100000:1.0:1789596722.044992:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789596722.045000:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964800128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596722.045239:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964800128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596722.045262:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789596722.046123:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900465500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964800128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596722.046178:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900465500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964800256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596722.046225:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596722.046271:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6948e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596722.047454:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964800256 00000100:00100000:2.0:1789596722.047481:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964800256 00000100:00100000:2.0:1789596722.047538:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789596722.047546:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964800256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596722.048141:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964800256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 594us (1913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596722.048151:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789596722.049478:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900465500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964800256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789596722.051595:0:11204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789596722.051849:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789596722.051867:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789596722.051877:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88c00/0x8973ae90b38d7a44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7a4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596722.051919:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88c00/0x8973ae90b38d7a44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7a4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596722.291796:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596722.291912:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944841984 00000100:00100000:3.0:1789596722.291923:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944841984 00000100:00100000:3.0:1789596722.291995:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 238 00000100:00100000:3.0:1789596722.292006:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+11:5592:x1876527944841984:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596722.292031:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596722.292051:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7a52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344cf9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596722.292079:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344cf9 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596722.292091:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344cf9 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596722.292099:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88800, rc 0) 00000100:00100000:3.0:1789596722.292159:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:5592:x1876527944841984:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 154us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596722.292166:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 238 00000100:00100000:1.0:1789596722.299227:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596722.299263:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944842112 00000100:00100000:1.0:1789596722.299274:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944842112 00000100:00100000:1.0:1789596722.299320:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 239 00000100:00100000:1.0:1789596722.299329:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:5592:x1876527944842112:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596722.301745:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:5592:x1876527944842112:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 2406us (2516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596722.301758:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 239 00000100:00100000:0.0:1789596722.318158:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596722.319478:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944842240 00000100:00100000:1.0:1789596722.319493:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944842240 00000100:00100000:0.0:1789596722.321294:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 240 00000100:00100000:0.0:1789596722.321308:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:5592:x1876527944842240:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596722.321556:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:5592:x1876527944842240:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 250us (3409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596722.321564:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 240 00000100:00100000:3.0:1789596722.330477:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596722.330562:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944842368 00000100:00100000:1.0:1789596722.330573:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944842368 00000100:00100000:1.0:1789596722.330634:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 241 00000100:00100000:1.0:1789596722.330644:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:5592:x1876527944842368:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596722.330662:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596722.330682:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d7a59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d00 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596722.330708:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d7a59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d00 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596722.330720:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d7a59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d00 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596722.330743:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea9021f9e00, rc 0) 00000100:00100000:1.0:1789596722.330803:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:5592:x1876527944842368:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 160us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596722.330811:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 241 00000100:00100000:0.0:1789596722.334480:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596722.334546:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944842496 00000100:00100000:1.0:1789596722.334555:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944842496 00000100:00100000:1.0:1789596722.334647:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 242 00000100:00100000:1.0:1789596722.334657:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:5592:x1876527944842496:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596722.334967:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:5592:x1876527944842496:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 303us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596722.334976:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 242 00000100:00100000:3.0:1789596722.338039:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596722.339760:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944842624 00000100:00100000:2.0:1789596722.339942:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944842624 00000100:00100000:2.0:1789596722.340084:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 243 00000100:00100000:2.0:1789596722.340100:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:5592:x1876527944842624:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596722.340921:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:5592:x1876527944842624:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 819us (2894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596722.340931:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 243 00010000:00010000:2.0:1789596722.977717:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596723.559296:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596723.559353:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596723.559682:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944842752 00000100:00100000:1.0:1789596723.559693:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944842752 00000100:00100000:1.0:1789596723.559757:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 244 00000100:00100000:1.0:1789596723.559768:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2354:x1876527944842752:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596723.559867:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2354:x1876527944842752:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 100us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596723.559875:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 244 00000100:00100000:1.0:1789596723.559923:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944842880 00000100:00100000:1.0:1789596723.559927:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944842880 00000100:00100000:1.0:1789596723.560100:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 89 00000100:00100000:1.0:1789596723.560108:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2353:x1876527944842880:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596723.560141:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2353:x1876527944842880:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 35us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596723.560264:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 89 00000100:00080000:1.0:1789596723.560371:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596723.560787:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596723.560865:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944843008 00000100:00100000:3.0:1789596723.560870:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944843008 00000100:00100000:3.0:1789596723.560921:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 90 00000100:00100000:3.0:1789596723.560929:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2354:x1876527944843008:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596723.561037:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2354:x1876527944843008:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 109us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596723.561045:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 90 00000100:00080000:1.0:1789596723.561275:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789596723.994920:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789596725.012296:0:11380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg244-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789596725.019105:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596725.275185:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964800384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596725.275261:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596725.275495:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964800384 00000100:00100000:3.0:1789596725.275505:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964800384 00000100:00080000:0.0:1789596725.275613:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596725.275652:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789596725.275664:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900465500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964800384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596725.275699:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596725.275756:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900465500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964800384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596725.275764:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1789596725.275859:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c5783800 x1876527964800384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596725.275890:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964800384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596725.787219:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964800512:0@lo:400:kworker.0 00000100:00100000:0.0:1789596725.787300:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596725.787369:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964801024:0@lo:400:kworker.0 00000100:00100000:0.0:1789596725.787397:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596725.787444:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596725.787450:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964800640:0@lo:400:kworker.0 00000100:00100000:0.0:1789596725.787490:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596725.787522:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964801024 00000100:00100000:0.0:1789596725.787531:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964801024 00000100:00100000:0.0:1789596725.787593:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789596725.787602:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900464000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964801024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596725.787658:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900464000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964801024:12345-0@lo:400:kworker.0 Request processed in 57us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596725.787665:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789596725.787690:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596725.787702:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964800896:0@lo:400:kworker.0 00000100:00100000:0.0:1789596725.787739:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596725.787758:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596725.787763:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964800768:0@lo:400:kworker.0 00000100:00100000:0.0:1789596725.787784:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789596725.787869:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c31e3800 x1876527964801024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596725.787882:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964801024:0@lo:400:kworker.0 00000100:00100000:1.0:1789596725.789090:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964800512 00000100:00100000:1.0:1789596725.789102:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964800512 00000100:00100000:1.0:1789596725.789157:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789596725.789166:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964800512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596725.789240:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964800512:12345-0@lo:400:kworker.0 Request processed in 75us (1938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596725.789247:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789596725.789282:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964800640 00000100:00100000:1.0:1789596725.789286:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964800640 00000100:00100000:1.0:1789596725.789313:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964800896 00000100:00100000:1.0:1789596725.789316:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964800896 00000100:00100000:1.0:1789596725.789338:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964800768 00000100:00100000:1.0:1789596725.789341:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964800768 00000100:00100000:1.0:1789596725.789355:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789596725.789361:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964800640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596725.789393:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964800640:12345-0@lo:400:kworker.0 Request processed in 32us (1901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596725.789399:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789596725.789412:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789596725.789418:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964800896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596725.789452:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964800896:12345-0@lo:400:kworker.0 Request processed in 34us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596725.789457:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789596725.789496:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789596725.789502:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964800768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596725.789532:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900464380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964800768:12345-0@lo:400:kworker.0 Request processed in 30us (1748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596725.789538:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1789596725.789562:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596725.789591:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964800768:0@lo:400:kworker.0 00000100:00100000:1.0:1789596725.789603:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964800896:0@lo:400:kworker.0 00000100:00100000:2.0:1789596725.789958:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964800640:0@lo:400:kworker.0 00000100:00100000:2.0:1789596725.789968:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964800512:0@lo:400:kworker.0 00010000:00010000:2.0:1789596726.042981:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596726.299905:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596726.299933:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964801152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596726.300019:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596726.300076:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964801152 00000100:00100000:0.0:1789596726.300084:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964801152 00000100:00100000:0.0:1789596726.300131:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789596726.300141:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964801152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596726.300176:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596726.300218:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964801152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596726.300243:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789596726.300573:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea900467100 x1876527964801152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596726.300595:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900467100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964801152:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789596727.067346:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596728.090977:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596728.679438:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596728.679495:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596728.679531:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596728.679572:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944843392 00000100:00100000:0.0:1789596728.679583:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944843392 00000100:00100000:0.0:1789596728.679638:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944843264 00000100:00100000:0.0:1789596728.679640:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944843264 00000100:00100000:0.0:1789596728.679660:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 94 00000100:00100000:0.0:1789596728.679668:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2351:x1876527944843392:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596728.679738:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900467100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2351:x1876527944843392:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 71us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596728.679744:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 94 00000100:00100000:0.0:1789596728.679763:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 95 00000100:00100000:0.0:1789596728.679769:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2351:x1876527944843264:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596728.679794:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900465c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2351:x1876527944843264:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 25us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596728.679799:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 95 00000100:00080000:0.0:1789596728.679847:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596728.680276:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944843136 00000100:00100000:3.0:1789596728.680282:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944843136 00000100:00100000:3.0:1789596728.680321:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 246 00000100:00100000:3.0:1789596728.680327:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2351:x1876527944843136:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596728.680384:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2351:x1876527944843136:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 56us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596728.680391:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 246 00010000:00010000:2.0:1789596729.114932:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789596729.458456:0:11480:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 18:12:07 (1789596727) === 00000100:00100000:0.0:1789596729.856135:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596729.856239:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596729.856454:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944843520 00000100:00100000:1.0:1789596729.856466:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944843520 00000100:00100000:1.0:1789596729.856531:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 14 00000100:00100000:1.0:1789596729.856543:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2352:x1876527944843520:12345-192.168.202.44@tcp:41:mkdir.0 00000004:00000024:1.0:1789596729.856603:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789596729.856710:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2352:x1876527944843520:12345-192.168.202.44@tcp:41:mkdir.0 Request processed in 169us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596729.856719:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 14 00000100:00100000:2.0:1789596729.856906:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944843648 00000100:00100000:2.0:1789596729.856911:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944843648 00000100:00100000:2.0:1789596729.856946:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 0 00000100:00100000:2.0:1789596729.856954:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:9685:x1876527944843648:12345-192.168.202.44@tcp:700:mkdir.0 00000100:00100000:2.0:1789596729.857007:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:9685:x1876527944843648:12345-192.168.202.44@tcp:700:mkdir.0 Request processed in 53us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596729.857014:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 0 00000100:00100000:0.0:1789596729.869574:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596729.869712:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944843904 00000100:00100000:3.0:1789596729.869726:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944843904 00000100:00100000:3.0:1789596729.869797:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 15 00000100:00100000:3.0:1789596729.869808:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:9685:x1876527944843904:12345-192.168.202.44@tcp:36:mkdir.0 00010000:00010000:3.0:1789596729.869921:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596729.869981:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89400/0x8973ae90b38d7941 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c82 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.870005:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8d1438d00) 00010000:00010000:3.0:1789596729.870032:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596729.870426:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7a60 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.870443:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7a60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.870454:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7a60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.870484:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7a67 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.870492:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7a67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.870499:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7a67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596729.872044:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789596729.872061:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7a60 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596729.872071:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7a60 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596729.872086:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7a60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596729.872093:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596729.872098:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7a60 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596729.872107:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7a60 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596729.872123:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:0.0:1789596729.872127:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596729.872132:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7a60 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596729.872138:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7a60 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789596729.872160:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bedcca7c reply state 0000000053b1b9d2 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7a67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596729.872170:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789596729.872282:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:9685:x1876527944843904:12345-192.168.202.44@tcp:36:mkdir.0 Request processed in 2471us (2725us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789596729.872290:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 15 00010000:00010000:1.0:1789596729.878080:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7a67 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596729.878099:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7a67 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596729.878108:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7a67 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596729.878115:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596729.878136:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7a67 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596729.878145:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7a67 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596729.878167:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ea8d1438500) 00010000:00010000:1.0:1789596729.878171:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596729.878176:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7a67 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596729.878182:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7a67 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596729.899589:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596729.899687:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944844032 00000100:00100000:1.0:1789596729.899696:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944844032 00000100:00100000:1.0:1789596729.899758:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 16 00000100:00100000:1.0:1789596729.899769:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:9688:x1876527944844032:12345-192.168.202.44@tcp:101:chmod.0 00010000:00010000:1.0:1789596729.899791:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596729.899861:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9600/0x8973ae90b38d7a6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d07 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596729.899936:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d7a75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596729.899950:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d7a75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596729.899963:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d7a75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596729.900036:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789596729.900041:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789596729.900101:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d7a75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596729.900129:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9600/0x8973ae90b38d7a6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d07 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596729.900150:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d7a75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d07 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596729.900158:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8c36d5500) 00010000:00010000:1.0:1789596729.900161:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789596729.900165:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea9021f9200, rc 0) 00000100:00100000:1.0:1789596729.900220:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:9688:x1876527944844032:12345-192.168.202.44@tcp:101:chmod.0 Request processed in 453us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596729.900227:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 16 00000100:00100000:3.0:1789596729.919379:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596729.919469:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944844288 00000100:00100000:2.0:1789596729.919481:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944844288 00000100:00100000:2.0:1789596729.919545:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 17 00000100:00100000:2.0:1789596729.919564:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:9688:x1876527944844288:12345-192.168.202.44@tcp:36:chmod.0 00010000:00010000:2.0:1789596729.919626:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596729.919653:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d7a75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d07 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596729.919675:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8c36d5500) 00010000:00010000:2.0:1789596729.919687:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596729.919718:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7a7c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596729.919732:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7a7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596729.919742:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7a7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596729.920309:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074506b8a reply state 000000002c922cd3 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7a7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596729.920320:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789596729.920330:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789596729.920464:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:9688:x1876527944844288:12345-192.168.202.44@tcp:36:chmod.0 Request processed in 909us (1096us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789596729.920483:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 17 00010000:00010000:0.0:1789596729.932093:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7a7c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596729.932111:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7a7c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596729.932132:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7a7c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596729.932139:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596729.932143:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7a7c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596729.932153:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7a7c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596729.932169:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea100) 00010000:00010000:0.0:1789596729.932172:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789596729.932176:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7a7c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596729.932183:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7a7c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596729.978124:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596729.978239:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944844416 00000100:00100000:1.0:1789596729.978250:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944844416 00000100:00100000:1.0:1789596729.978387:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 18 00000100:00100000:1.0:1789596729.978398:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:9689:x1876527944844416:12345-192.168.202.44@tcp:101:chown.0 00010000:00010000:1.0:1789596729.978422:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596729.978445:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9600/0x8973ae90b38d7a83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d0e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596729.978512:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8800/0x8973ae90b38d7a8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596729.978545:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8800/0x8973ae90b38d7a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596729.978558:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8800/0x8973ae90b38d7a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596729.978607:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789596729.978611:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789596729.978651:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8800/0x8973ae90b38d7a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596729.978678:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9600/0x8973ae90b38d7a83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d0e expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596729.978698:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8800/0x8973ae90b38d7a8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d0e expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596729.978707:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8c36d5000) 00010000:00010000:1.0:1789596729.978710:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789596729.978714:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea9021f8800, rc 0) 00000100:00100000:1.0:1789596729.978772:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:9689:x1876527944844416:12345-192.168.202.44@tcp:101:chown.0 Request processed in 376us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596729.978779:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 18 00000100:00100000:2.0:1789596729.982205:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596729.982302:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944844544 00000100:00100000:3.0:1789596729.982313:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944844544 00000100:00100000:3.0:1789596729.982372:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 19 00000100:00100000:3.0:1789596729.982383:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:9689:x1876527944844544:12345-192.168.202.44@tcp:101:chown.0 00010000:00010000:3.0:1789596729.982404:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596729.982425:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89400/0x8973ae90b38d7a91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d15 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.982492:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89800/0x8973ae90b38d7a98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.982508:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89800/0x8973ae90b38d7a98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.982521:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89800/0x8973ae90b38d7a98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.982536:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7a9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.982544:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7a9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.982563:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7a9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.982666:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7aa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.982684:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.982691:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596729.982726:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789596729.982731:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789596729.982751:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.982763:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89800/0x8973ae90b38d7a98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.982770:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89800/0x8973ae90b38d7a98 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.982776:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89800/0x8973ae90b38d7a98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.983011:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596729.983016:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89800/0x8973ae90b38d7a98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.983025:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89800/0x8973ae90b38d7a98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.983038:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8c36d5000) 00010000:00010000:3.0:1789596729.983041:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596729.983046:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89800/0x8973ae90b38d7a98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.983063:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89800/0x8973ae90b38d7a98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.983077:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7a9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.983083:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7a9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.983090:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7a9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.983095:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596729.983099:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7a9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.983105:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7a9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.983113:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ea8d1438d00) 00010000:00010000:3.0:1789596729.983115:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596729.983118:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7a9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.983124:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7a9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.983160:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89400/0x8973ae90b38d7a91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d15 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.983175:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d15 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596729.983187:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ea8d1438f00) 00010000:00010000:3.0:1789596729.983190:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789596729.983192:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88400, rc 0) 00000100:00100000:3.0:1789596729.983249:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:9689:x1876527944844544:12345-192.168.202.44@tcp:101:chown.0 Request processed in 867us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596729.983256:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 19 00000100:00100000:3.0:1789596729.987586:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596729.987688:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944844800 00000100:00100000:0.0:1789596729.987700:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944844800 00000100:00100000:0.0:1789596729.987768:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 20 00000100:00100000:0.0:1789596729.987778:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:9689:x1876527944844800:12345-192.168.202.44@tcp:36:chown.0 00010000:00010000:0.0:1789596729.987869:0:10902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596729.987904:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7aa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d15 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596729.987923:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ea8d1438f00) 00010000:00010000:0.0:1789596729.987938:0:10902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596729.987965:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7aad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596729.987994:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7aad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596729.988006:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7aad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789596730.082795:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1789596730.082912:0:10902:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5900eb6 reply state 000000001e790d52 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7aad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596730.082926:0:10902:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789596730.082939:0:10902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1789596730.083045:0:10902:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789596730.083073:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:9689:x1876527944844800:12345-192.168.202.44@tcp:36:chown.0 Request processed in 95292us (95495us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789596730.083082:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 20 00010000:00010000:1.0:1789596730.083386:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7aad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.083397:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7aad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.083422:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7aad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.083429:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596730.083434:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7aad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.083443:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7aad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.083573:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ea8d55e5300) 00010000:00010000:1.0:1789596730.083577:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789596730.083583:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7aad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.083590:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7aad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596730.108570:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596730.108862:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944844928 00000100:00100000:0.0:1789596730.108874:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944844928 00000100:00100000:0.0:1789596730.108953:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 21 00000100:00100000:0.0:1789596730.108963:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:9690:x1876527944844928:12345-192.168.202.44@tcp:101:touch.500 00010000:00010000:0.0:1789596730.108989:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596730.109011:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7ab4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d1c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789596730.109201:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789596730.109913:0:5841:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 844us 00010000:00010000:0.0:1789596730.153109:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7abb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153135:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7abb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153156:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7abb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153173:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031400/0x8973ae90b38d7ac2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153180:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031400/0x8973ae90b38d7ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153186:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031400/0x8973ae90b38d7ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153513:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7ac9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153523:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153530:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596730.153554:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789596730.153558:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789596730.153594:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153605:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7abb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153611:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7abb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153627:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7abb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153633:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596730.153637:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7abb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153644:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7abb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153656:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8c36d5000) 00010000:00010000:0.0:1789596730.153658:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596730.153663:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7abb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153669:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7abb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153680:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031400/0x8973ae90b38d7ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153685:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031400/0x8973ae90b38d7ac2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153690:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031400/0x8973ae90b38d7ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153694:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596730.153696:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031400/0x8973ae90b38d7ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153709:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031400/0x8973ae90b38d7ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153717:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ea8d55e5500) 00010000:00010000:0.0:1789596730.153719:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596730.153722:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031400/0x8973ae90b38d7ac2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153727:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031400/0x8973ae90b38d7ac2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153764:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7ab4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d1c expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153781:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d1c expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.153788:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ea8d55e5700) 00010000:00010000:0.0:1789596730.153790:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789596730.153792:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030c00, rc 0) 00000100:00100000:0.0:1789596730.153915:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:9690:x1876527944844928:12345-192.168.202.44@tcp:101:touch.500 Request processed in 44950us (45360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596730.153924:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 21 00000100:00100000:3.0:1789596730.159519:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596730.161578:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944845184 00000100:00100000:1.0:1789596730.161599:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944845184 00000100:00100000:1.0:1789596730.161684:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 22 00000100:00100000:1.0:1789596730.161696:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:9690:x1876527944845184:12345-192.168.202.44@tcp:101:touch.500 00010000:00010000:1.0:1789596730.161718:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596730.161748:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9600/0x8973ae90b38d7ad0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d23 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.162399:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7ad7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.162432:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7ad7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.162446:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7ad7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.162488:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d7ade lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.162496:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d7ade lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.162504:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d7ade lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596730.168314:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789596730.171417:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789596730.171741:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7ae5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.171759:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.171773:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.171809:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7ad7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.171853:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7ad7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.171860:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7ad7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.171866:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f8400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596730.171871:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7ad7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.171879:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7ad7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.171892:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ea8d55e5700) 00010000:00010000:2.0:1789596730.171896:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596730.171912:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7ad7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.171919:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7ad7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596730.171933:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008565a537 reply state 00000000fd57f4b2 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d7ade lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596730.171942:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789596730.171980:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9600/0x8973ae90b38d7ad0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d23 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.171995:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d23 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.172001:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:2.0:1789596730.172004:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596730.172006:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426400, rc 0) 00000100:00100000:2.0:1789596730.172094:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+10:9690:x1876527944845184:12345-192.168.202.44@tcp:101:touch.500 Request processed in 10400us (12584us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789596730.172103:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 22 00010000:00010000:2.0:1789596730.176695:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d7ade lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.176716:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d7ade lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.176725:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d7ade lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.176754:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f9200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596730.176759:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d7ade lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.176767:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d7ade lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.176785:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff9ea8c36d5900) 00010000:00010000:2.0:1789596730.176788:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596730.176794:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d7ade lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.176800:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d7ade lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596730.179596:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596730.182718:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944845440 00000100:00100000:2.0:1789596730.182738:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944845440 00000100:00100000:2.0:1789596730.182871:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 23 00000100:00100000:2.0:1789596730.182882:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:9690:x1876527944845440:12345-192.168.202.44@tcp:36:touch.500 00010000:00010000:2.0:1789596730.182947:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596730.182979:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7ae5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d23 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.183007:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:2.0:1789596730.183018:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596730.183062:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7af3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.183075:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7af3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.183101:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7af3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596730.183243:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001addfe9e reply state 00000000d594ab00 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7af3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596730.183253:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789596730.183579:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+10:9690:x1876527944845440:12345-192.168.202.44@tcp:36:touch.500 Request processed in 699us (3993us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789596730.183588:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 23 00010000:00010000:1.0:1789596730.192171:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7af3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.192191:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7af3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.192200:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7af3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.192206:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596730.192212:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7af3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.192220:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7af3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.192239:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ea8e0eea700) 00010000:00010000:1.0:1789596730.192262:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596730.192268:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7af3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.192275:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7af3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596730.201970:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596730.202078:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944845568 00000100:00100000:0.0:1789596730.202089:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944845568 00000100:00100000:0.0:1789596730.202158:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 24 00000100:00100000:0.0:1789596730.202169:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:9690:x1876527944845568:12345-192.168.202.44@tcp:101:touch.500 00010000:00010000:0.0:1789596730.202210:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596730.202235:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7afa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d2a expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.202293:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7afa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d2a expref: 10 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.202309:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7afa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d2a expref: 10 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.202329:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ea8d55e5500) 00010000:00010000:0.0:1789596730.202332:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789596730.202335:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030e00, rc 0) 00000100:00100000:0.0:1789596730.202393:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+10:9690:x1876527944845568:12345-192.168.202.44@tcp:101:touch.500 Request processed in 226us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596730.202400:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 24 00000100:00100000:2.0:1789596730.209237:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596730.212782:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944845696 00000100:00100000:1.0:1789596730.212799:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944845696 00000100:00100000:3.0:1789596730.220248:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 16 00000100:00100000:3.0:1789596730.220261:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1876527944845696:12345-192.168.202.44@tcp:8:touch.500 00010000:00080000:3.0:1789596730.220296:0:9219:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:3.0:1789596730.220329:0:9219:0:(genops.c:1384:class_connect()) connect: client 1fdd0e7b-fe25-4537-b350-ae6aecfab059, cookie 0x8973ae90b38d7b01 00002000:00100000:3.0:1789596730.220342:0:9219:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1fdd0e7b-fe25-4537-b350-ae6aecfab059/ffff9ea8f6595000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789596730.220365:0:9219:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789596730.221901:0:9219:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789596730.221945:0:9219:0:(import.c:65:import_set_state_nolock()) ffff9ea8f6591800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789596730.222179:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2350:x1876527944845696:12345-192.168.202.44@tcp:8:touch.500 Request processed in 1916us (12950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596730.222190:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 16 00000100:00100000:0.0:1789596730.232731:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596730.232861:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944845824 00000100:00100000:2.0:1789596730.232872:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944845824 00000100:00100000:2.0:1789596730.232948:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 17 00000100:00100000:2.0:1789596730.232958:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:0:x1876527944845824:12345-192.168.202.44@tcp:2:touch.500 00000100:00080000:1.0:1789596730.233160:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789596730.321530:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1789596730.321551:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1fdd0e7b-fe25-4537-b350-ae6aecfab059 00000100:00100000:1.0:1789596730.324111:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:0:x1876527944845824:12345-192.168.202.44@tcp:2:touch.500 Request processed in 91145us (91382us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789596730.324124:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 17 00000100:00100000:2.0:1789596730.327229:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596730.327375:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944846080 00000100:00100000:1.0:1789596730.327385:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944846080 00000100:00100000:1.0:1789596730.327449:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2 00000100:00100000:1.0:1789596730.327459:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+10:9690:x1876527944846080:12345-192.168.202.44@tcp:35:touch.500 00000100:00100000:1.0:1789596730.327998:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+11:9690:x1876527944846080:12345-192.168.202.44@tcp:35:touch.500 Request processed in 535us (773us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789596730.328008:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2 00000100:00100000:3.0:1789596730.391110:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596730.391307:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944846208 00000100:00100000:1.0:1789596730.391317:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944846208 00000100:00100000:1.0:1789596730.391380:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 25 00000100:00100000:1.0:1789596730.391391:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+11:9691:x1876527944846208:12345-192.168.202.44@tcp:101:rm.0 00010000:00010000:1.0:1789596730.391416:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596730.391438:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d7b08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d31 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.391502:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9600/0x8973ae90b38d7b0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.391523:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9600/0x8973ae90b38d7b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.391536:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9600/0x8973ae90b38d7b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596730.391572:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789596730.391575:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789596730.391610:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9600/0x8973ae90b38d7b0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.391635:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d7b08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d31 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.391655:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9600/0x8973ae90b38d7b0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d31 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.391663:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ea8d55e5700) 00010000:00010000:1.0:1789596730.391666:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789596730.391669:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea9021f9600, rc 0) 00000100:00100000:1.0:1789596730.391737:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+12:9691:x1876527944846208:12345-192.168.202.44@tcp:101:rm.0 Request processed in 347us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596730.391744:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 25 00000100:00100000:1.0:1789596730.396224:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789596730.396258:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964801280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596730.396328:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596730.399395:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596730.399702:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944846464 00000100:00100000:3.0:1789596730.399712:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944846464 00000100:00100000:3.0:1789596730.399796:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 26 00000100:00100000:3.0:1789596730.399808:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+12:9691:x1876527944846464:12345-192.168.202.44@tcp:101:rm.0 00010000:00010000:3.0:1789596730.399865:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789596730.399888:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964801280 00010000:00010000:3.0:1789596730.399890:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89400/0x8973ae90b38d7b16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d38 expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596730.399895:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964801280 00000100:00100000:2.0:1789596730.399940:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789596730.399950:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964801280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596730.399968:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789596730.400039:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964801280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (3710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596730.400046:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1789596730.400114:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c5783800 x1876527964801280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596730.400135:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964801280:0@lo:13:osp-pre-0-0.0 00000004:00200000:3.0:1789596730.400173:0:10902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00080000:1.0:1789596730.400271:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789596730.400340:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89400/0x8973ae90b38d7b16 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d38 expref: 14 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596730.400356:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8c36d5000) 00010000:00010000:3.0:1789596730.400360:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789596730.400366:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89400/0x8973ae90b38d7b16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d38 expref: 14 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596730.400379:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89400, rc 0) 00000100:00100000:3.0:1789596730.400428:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:9691:x1876527944846464:12345-192.168.202.44@tcp:101:rm.0 Request processed in 623us (1045us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1789596730.400436:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 26 00000100:00100000:2.0:1789596730.415678:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596730.415855:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944846592 00000100:00100000:0.0:1789596730.415865:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944846592 00000100:00100000:0.0:1789596730.415917:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 3 00000100:00100000:0.0:1789596730.415927:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:9691:x1876527944846592:12345-192.168.202.44@tcp:37:rm.0 00000100:00100000:2.0:1789596730.424763:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:9691:x1876527944846592:12345-192.168.202.44@tcp:37:rm.0 Request processed in 8824us (9084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596730.424775:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 3 00000100:00100000:0.0:1789596730.439057:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596730.439226:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944846848 00000100:00100000:1.0:1789596730.439261:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944846848 00000100:00100000:1.0:1789596730.439329:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 4 00000100:00100000:1.0:1789596730.439340:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3552050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:9691:x1876527944846848:12345-192.168.202.44@tcp:35:rm.0 00000100:00100000:1.0:1789596730.439726:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3552050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:9691:x1876527944846848:12345-192.168.202.44@tcp:35:rm.0 Request processed in 386us (679us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789596730.439735:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 4 00000100:00100000:3.0:1789596730.450366:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596730.450576:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944847104 00000100:00100000:2.0:1789596730.450586:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944847104 00000100:00100000:2.0:1789596730.450649:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 27 00000100:00100000:2.0:1789596730.450660:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:9691:x1876527944847104:12345-192.168.202.44@tcp:101:rm.0 00010000:00010000:2.0:1789596730.450686:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596730.450713:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d3f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.450888:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7b2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.450905:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7b2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.450918:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7b2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596730.450930:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789596730.451104:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d3f expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.451124:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7b2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d3f expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.451140:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ea8d55e5700) 00010000:00010000:2.0:1789596730.451143:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789596730.451148:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427800, rc 0) 00000100:00100000:2.0:1789596730.451208:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:9691:x1876527944847104:12345-192.168.202.44@tcp:101:rm.0 Request processed in 551us (854us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789596730.451216:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 27 00000100:00100000:0.0:1789596730.453928:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596730.454406:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944847232 00000100:00100000:2.0:1789596730.454417:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944847232 00000100:00100000:2.0:1789596730.454477:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 28 00000100:00100000:2.0:1789596730.454487:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:9691:x1876527944847232:12345-192.168.202.44@tcp:41:rm.0 00000004:00000024:2.0:1789596730.454548:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1789596730.454625:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:9691:x1876527944847232:12345-192.168.202.44@tcp:41:rm.0 Request processed in 139us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596730.454633:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 28 00000100:00100000:0.0:1789596730.459270:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596730.459356:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944847360 00000100:00100000:2.0:1789596730.459367:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944847360 00000100:00100000:2.0:1789596730.459431:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 29 00000100:00100000:2.0:1789596730.459441:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:9691:x1876527944847360:12345-192.168.202.44@tcp:101:rm.0 00010000:00010000:2.0:1789596730.459462:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596730.459485:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7b39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d46 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459568:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7b40 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459583:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459612:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459630:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7b47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459638:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459645:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459759:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7b4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459767:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459774:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596730.459800:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789596730.459804:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789596730.459864:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459876:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459884:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7b40 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459900:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7b40 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459907:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7b40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459914:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596730.459918:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7b40 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459926:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7b40 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459938:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ea8d55e5700) 00010000:00010000:2.0:1789596730.459942:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596730.459946:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7b40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459953:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7b40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459968:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459974:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7b47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459980:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.459986:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596730.459995:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.460001:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7b47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.460010:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff9ea8e0eea900) 00010000:00010000:2.0:1789596730.460012:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596730.460015:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7b47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.460021:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7b47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.460053:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7b39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d46 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.460068:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d46 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.460076:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ea8d55e5500) 00010000:00010000:2.0:1789596730.460079:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596730.460081:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426e00, rc 0) 00000100:00100000:2.0:1789596730.460150:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+17:9691:x1876527944847360:12345-192.168.202.44@tcp:101:rm.0 Request processed in 710us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596730.460157:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 29 00000100:00100000:0.0:1789596730.467711:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596730.467794:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944847616 00000100:00100000:2.0:1789596730.467854:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944847616 00000100:00100000:2.0:1789596730.467911:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 30 00000100:00100000:2.0:1789596730.467922:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+17:9691:x1876527944847616:12345-192.168.202.44@tcp:36:rm.0 00010000:00010000:2.0:1789596730.467995:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789596730.468022:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7b4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d46 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.468046:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7afa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d2a expref: 16 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.468060:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ea8d55e5500) 00010000:00010000:2.0:1789596730.468076:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9600/0x8973ae90b38d7b0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d31 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.468085:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ea8d55e5700) 00010000:00010000:2.0:1789596730.468089:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596730.468107:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.468121:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.468131:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.468145:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7b5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.468152:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7b5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.468159:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7b5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.468300:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.468308:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.468315:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789596730.469061:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789596730.469075:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 315433258241ns, next at 316433255113ns, rc = 0 00010000:00010000:2.0:1789596730.469150:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7b6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.469161:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7b6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.469170:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7b6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.469179:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7b6a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.469186:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7b6a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.469193:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7b6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.469219:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596730.469250:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.469267:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b63 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.469274:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.469282:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596730.469289:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.469299:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b63 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.469311:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:2.0:1789596730.469314:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789596730.469321:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b63 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.469327:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b63 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.469348:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.469355:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b55 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.469362:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.469367:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596730.469377:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.469385:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.469393:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ea8d55e5700) 00010000:00010000:2.0:1789596730.469395:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596730.469399:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b55 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.469405:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596730.469418:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000beba2591 reply state 00000000b0a67d82 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7b5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596730.469427:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789596730.469544:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:9691:x1876527944847616:12345-192.168.202.44@tcp:36:rm.0 Request processed in 1620us (1839us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789596730.469555:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 30 00010000:00010000:0.0:1789596730.470119:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596730.470135:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7b6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.470142:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426600 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596730.470145:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7b6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.470152:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7b6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.470163:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:0.0:1789596730.470166:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789596730.470169:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7b6a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.470175:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7b6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596730.470192:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596730.470194:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596730.470196:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596730.473884:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7b5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.473904:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7b5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.473914:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7b5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.473920:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427a00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596730.473926:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7b5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.473953:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7b5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.473972:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff9ea8e0eeae00) 00010000:00010000:2.0:1789596730.473975:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596730.473981:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7b5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.473987:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7b5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596730.475322:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596730.475395:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944847872 00000100:00100000:1.0:1789596730.475406:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944847872 00000100:00100000:1.0:1789596730.475464:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 5 00000100:00100000:1.0:1789596730.475474:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+15:9691:x1876527944847872:12345-192.168.202.44@tcp:35:rm.0 00000100:00100000:1.0:1789596730.475732:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:9691:x1876527944847872:12345-192.168.202.44@tcp:35:rm.0 Request processed in 259us (418us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789596730.475739:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 5 00000100:00100000:3.0:1789596730.487515:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596730.487609:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944848128 00000100:00100000:2.0:1789596730.487619:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944848128 00000100:00100000:2.0:1789596730.487682:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 31 00000100:00100000:2.0:1789596730.487691:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:9691:x1876527944848128:12345-192.168.202.44@tcp:36:rm.0 00010000:00010000:2.0:1789596730.487752:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789596730.487779:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7b2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d3f expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.487800:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7ac9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d1c expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.487812:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ea8d55e5700) 00010000:00010000:2.0:1789596730.487887:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8800/0x8973ae90b38d7a8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d0e expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.487897:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8c36d5000) 00010000:00010000:2.0:1789596730.487919:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596730.487943:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b71 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.487956:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.487966:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.487978:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b78 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.487986:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.487992:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.488240:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7b7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.488249:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7b7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.488257:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7b7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596730.488801:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789596730.488870:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7b7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.488878:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7b7f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.488892:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7b7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.488898:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596730.488902:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7b7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.488911:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7b7f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.488921:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ea8e0eea600) 00010000:00010000:2.0:1789596730.488924:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789596730.488928:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7b7f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.488934:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7b7f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.488959:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.488966:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b71 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.488971:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b71 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.488976:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596730.488979:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b71 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.488995:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b71 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.489003:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea900) 00010000:00010000:2.0:1789596730.489006:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596730.489009:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b71 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596730.489015:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7b71 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596730.489027:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039922713 reply state 000000006fb43ff9 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596730.489036:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789596730.489108:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+15:9691:x1876527944848128:12345-192.168.202.44@tcp:36:rm.0 Request processed in 1417us (1604us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789596730.489116:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 31 00010000:00010000:1.0:1789596730.496259:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.496279:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b78 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.496287:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b78 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.496293:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596730.496298:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b78 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.496305:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b78 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.496341:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ea8e0eea000) 00010000:00010000:1.0:1789596730.496345:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596730.496350:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b78 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596730.496357:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7b78 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596730.907223:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964801536:0@lo:400:kworker.0 00000100:00100000:0.0:1789596730.907329:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596730.907410:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596730.907418:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964801664:0@lo:400:kworker.0 00000100:00100000:0.0:1789596730.907444:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596730.907522:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964801536 00000100:00100000:3.0:1789596730.907530:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964801536 00000100:00100000:3.0:1789596730.907581:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964801664 00000100:00100000:3.0:1789596730.907584:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964801664 00000100:00100000:3.0:1789596730.907620:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789596730.907639:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964801536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596730.907698:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5708700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964801536:12345-0@lo:400:kworker.0 Request processed in 61us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596730.907706:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789596730.907724:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789596730.907732:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964801664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596730.907759:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5708e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964801664:12345-0@lo:400:kworker.0 Request processed in 29us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596730.907765:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1789596730.907850:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596730.907865:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964801792:0@lo:400:kworker.0 00000100:00100000:1.0:1789596730.907896:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596730.907922:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789596730.907929:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964801408:0@lo:400:kworker.0 00000100:00100000:1.0:1789596730.907959:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596730.907983:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964801920:0@lo:400:kworker.0 00000100:00100000:1.0:1789596730.908009:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596730.908038:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964801408 00000100:00100000:1.0:1789596730.908042:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964801408 00000100:00100000:1.0:1789596730.908069:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789596730.908076:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964801408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596730.908106:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964801408:12345-0@lo:400:kworker.0 Request processed in 31us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596730.908112:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789596730.908137:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964801920 00000100:00100000:1.0:1789596730.908141:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964801920 00000100:00100000:1.0:1789596730.908167:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789596730.908172:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964801920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596730.908207:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964801920:12345-0@lo:400:kworker.0 Request processed in 34us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596730.908213:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1789596730.908227:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789596730.908249:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964801408:0@lo:400:kworker.0 00010000:00080000:1.0:1789596730.908263:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8f67c7b80 x1876527964801920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596730.908274:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964801920:0@lo:400:kworker.0 00000100:00100000:0.0:1789596730.908364:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964801664:0@lo:400:kworker.0 00000100:00100000:0.0:1789596730.908374:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964801536:0@lo:400:kworker.0 00000100:00100000:0.0:1789596730.908396:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964801792 00000100:00100000:0.0:1789596730.908407:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964801792 00000100:00100000:0.0:1789596730.908443:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789596730.908448:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876527964801792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596730.908482:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876527964801792:12345-0@lo:400:kworker.0 Request processed in 33us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596730.908488:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1789596730.908750:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596730.908773:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964801792:0@lo:400:kworker.0 00010000:00010000:2.0:1789596731.229361:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596731.419049:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c570b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964802048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596731.419135:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596731.419223:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964802048 00000100:00100000:0.0:1789596731.419231:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964802048 00000100:00100000:0.0:1789596731.419276:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789596731.419284:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964802048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596731.419337:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596731.419383:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5709f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964802048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596731.419390:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1789596731.419434:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c570b480 x1876527964802048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596731.419454:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c570b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964802048:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789596732.254136:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596733.277395:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596733.807976:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596733.808033:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596733.808067:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596733.808106:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596733.808271:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944848256 00000100:00100000:0.0:1789596733.808271:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944848512 00000100:00100000:2.0:1789596733.808282:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944848256 00000100:00100000:0.0:1789596733.808282:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944848512 00000100:00100000:2.0:1789596733.808333:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 248 00000100:00100000:0.0:1789596733.808336:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 44 00000100:00100000:2.0:1789596733.808342:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2351:x1876527944848256:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596733.808342:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2351:x1876527944848512:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596733.808406:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2351:x1876527944848256:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 65us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596733.808413:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 248 00000100:00100000:1.0:1789596733.808426:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944848384 00000100:00100000:1.0:1789596733.808430:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944848384 00000100:00100000:1.0:1789596733.808454:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944848640 00000100:00100000:1.0:1789596733.808457:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944848640 00000100:00080000:3.0:1789596733.808511:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789596733.808522:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596733.808904:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2351:x1876527944848512:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 560us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596733.808913:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 44 00000100:00100000:0.0:1789596733.808957:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 99 00000100:00100000:0.0:1789596733.808965:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:2351:x1876527944848384:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596733.809004:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:2351:x1876527944848384:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 41us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596733.809010:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 99 00000100:00100000:2.0:1789596733.819382:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 100 00000100:00100000:2.0:1789596733.819408:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2351:x1876527944848640:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596733.819488:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2351:x1876527944848640:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 82us (11380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596733.819495:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 100 00000100:00080000:3.0:1789596733.827497:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789596734.299027:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789596735.121050:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:2.0:1789596735.121075:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1789596735.121084:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1789596735.121337:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964802176:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789596735.121410:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596735.121491:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964802176 00000100:00100000:3.0:1789596735.121500:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964802176 00000100:00100000:3.0:1789596735.121564:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789596735.121575:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c570b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964802176:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1789596735.121593:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1789596735.121600:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1789596735.121633:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aab143a, atime: 0x6aab143a, ctime: 0x6aab143a, blocks: 0x1 00010000:00010000:3.0:1789596735.121643:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d29bf171/0x8973ae90b38d7b86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596735.121660:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1789596735.121664:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596735.121678:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d29bf171/0x8973ae90b38d7b86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596735.121695:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d29bf171/0x8973ae90b38d7b86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596735.121706:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d29bf171/0x8973ae90b38d7b86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596735.121713:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d29bf171/0x8973ae90b38d7b86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596735.121784:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596735.121927:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596735.121934:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d29bf171/0x8973ae90b38d7b86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596735.121942:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89c00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596735.121947:0:7643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d29bf171/0x8973ae90b38d7b86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596735.121957:0:7643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d29bf171/0x8973ae90b38d7b86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596735.121975:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d29bf171/0x8973ae90b38d7b86 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596735.121982:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d29bf171/0x8973ae90b38d7b86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596735.122001:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596735.122008:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596735.122009:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596735.123617:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c570b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876527964802176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2038us (2200us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789596735.123630:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1789596735.124439:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ea8f67c4000/2, rc 0, transno 4294967300 00000100:00100000:0.0:1789596735.124450:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964802176:0@lo:6:osp-syn-0-0.0 00000001:02000400:0.0:1789596735.132617:0:11631:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1789596735.351466:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596735.525079:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964802304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596735.525157:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596735.525243:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964802304 00000100:00100000:3.0:1789596735.525251:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964802304 00000100:00100000:3.0:1789596735.525299:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789596735.525308:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876527964802304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596735.525341:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596735.525384:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876527964802304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596735.525391:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789596735.525465:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964802304:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1789596735.613967:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000020:00000080:0.0:1789596735.813738:0:11679:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc73d820f0 20000000:00000080:0.0:1789596735.813757:0:11679:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ea90006b400 uarg=0000000000000000 20000000:01000000:0.0:1789596735.813806:0:11679:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789596735.813958:0:11679:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789596735.813964:0:11679:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789596735.814631:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789596735.814796:0:11679:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789596735.820636:0:11679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789596735.820702:0:11679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789596735.820758:0:11679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789596735.820787:0:11679:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789596735.820806:0:11679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7b8d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596735.821106:0:11679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8d5f89600/0x8973ae90b38d7a2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7a28 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596735.821116:0:11679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d7a3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7a36 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596735.821123:0:11679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d7a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7a44 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596735.821132:0:11679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7a52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344cf9 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596735.821150:0:11679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d7a59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d00 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596735.821156:0:11679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7b8d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596735.821194:0:11679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d7a59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d00 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596735.821209:0:11679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d7a59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d00 expref: 12 pid: 5834 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596735.821225:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c570b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876527964802432:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596735.821318:0:11679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344cf9 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596735.821328:0:11679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7a52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344cf9 expref: 12 pid: 5834 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596735.821337:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5708380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876527964802560:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596735.821367:0:11679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d7a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d7a44 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596735.821376:0:11679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d7a4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d7a44 expref: 18 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596735.821385:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c570ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876527964802688:0@lo:104: 00000100:00100000:0.0:1789596735.821425:0:11679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789596735.821475:0:11679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d7a3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d7a36 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596735.821482:0:11679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d7a3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d7a36 expref: 18 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596735.821491:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c570a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876527964802816:0@lo:104: 00000100:00100000:0.0:1789596735.821524:0:11679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789596735.821546:0:11679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8d5f89600/0x8973ae90b38d7a2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d7a28 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596735.821554:0:11679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ea8d5f89600/0x8973ae90b38d7a2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d7a28 expref: 18 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596735.821561:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c570aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876527964802944:0@lo:104: 00000100:00100000:0.0:1789596735.821581:0:11679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596735.821592:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c60e3540 going to sleep for 11 seconds 00000100:00100000:2.0:1789596735.821898:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789596735.821912:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964802688 00000100:00100000:2.0:1789596735.821920:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964802688 00000100:00100000:2.0:1789596735.821956:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964802816 00000100:00100000:2.0:1789596735.821960:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964802816 00000100:00100000:2.0:1789596735.821969:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964802944 00000100:00100000:2.0:1789596735.821971:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964802944 00000100:00100000:2.0:1789596735.821982:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789596735.822270:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c570bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+5:11679:x1876527964802688:12345-0@lo:104: 00010000:00010000:2.0:1789596735.822283:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88c00/0x8973ae90b38d7a44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7a4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.822348:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789596735.822354:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c570bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+5:11679:x1876527964802688:12345-0@lo:104: Request processed in 89us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596735.822360:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789596735.822380:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789596735.822386:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c570a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+4:11679:x1876527964802816:12345-0@lo:104: 00010000:00010000:2.0:1789596735.822394:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7a36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7a3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.822438:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789596735.822443:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c570a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+4:11679:x1876527964802816:12345-0@lo:104: Request processed in 58us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596735.822450:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789596735.822461:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789596735.822467:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:11679:x1876527964802944:12345-0@lo:104: 00010000:00010000:2.0:1789596735.822473:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7a28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7a2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596735.822584:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c570ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876527964802688:0@lo:104: 00000100:00100000:0.0:1789596735.822593:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c570a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876527964802816:0@lo:104: 00000100:00100000:0.0:1789596735.822600:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c570aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876527964802944:0@lo:104: 00010000:00010000:2.0:1789596735.822686:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789596735.822692:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1f0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+3:11679:x1876527964802944:12345-0@lo:104: Request processed in 226us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596735.822699:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1789596735.822737:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789596735.822743:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88c00/0x8973ae90b38d7a44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7a4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.822750:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88c00 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596735.822754:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88c00/0x8973ae90b38d7a44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d7a4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.822762:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88c00/0x8973ae90b38d7a44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d7a4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596735.822780:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88c00/0x8973ae90b38d7a44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d7a4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596735.822786:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789596735.822851:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88c00/0x8973ae90b38d7a44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7a4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.822858:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596735.822878:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88c00/0x8973ae90b38d7a44 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7a4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.822887:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88c00/0x8973ae90b38d7a44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7a4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.822899:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789596735.822902:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7a36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7a3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.822908:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f9800 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596735.822910:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7a36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d7a3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.822917:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7a36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d7a3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596735.822924:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7a36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d7a3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596735.822928:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789596735.822941:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7a36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7a3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.822947:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596735.822962:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7a36 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7a3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.822979:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9800/0x8973ae90b38d7a36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7a3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.823148:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596735.823151:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7a28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d7a2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.823157:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426200 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596735.823161:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7a28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d7a2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.823167:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7a28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d7a2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596735.823172:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7a28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d7a2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596735.823177:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789596735.823191:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7a28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7a2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.823197:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596735.823204:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7a28 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7a2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.823210:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7a28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d7a2f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.823222:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596735.823229:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596735.823231:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596735.823237:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596735.823258:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964803072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596735.823294:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596735.823346:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964803200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596735.823367:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596735.823384:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596735.823390:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964803328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596735.823410:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596735.823438:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964803072 00000100:00100000:2.0:1789596735.823444:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964803072 00010000:00010000:2.0:1789596735.823464:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d7a4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d7a44 expref: 19 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596735.823484:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964803200 00000100:00100000:2.0:1789596735.823487:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964803200 00010000:00010000:2.0:1789596735.823498:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d7a3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d7a36 expref: 20 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596735.823596:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596735.823680:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964803328 00000100:00100000:1.0:1789596735.823684:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964803328 00010000:00010000:1.0:1789596735.823700:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8d5f89600/0x8973ae90b38d7a2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d7a28 expref: 21 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596735.823716:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789596735.823722:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5783b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+21:3309:x1876527964803072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789596735.823733:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596735.823738:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d7a4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d7a44 expref: 21 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596735.823759:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d7a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d7a44 expref: 21 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596735.823782:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8c0030800/0x8973ae90b38d7a4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d7a44 expref: 21 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596735.823798:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596735.823864:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5783b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+20:3309:x1876527964803072:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596735.823870:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789596735.823885:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789596735.823891:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c8280050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964803328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789596735.823899:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596735.823903:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8d5f89600/0x8973ae90b38d7a2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d7a28 expref: 19 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596735.823910:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8d5f89600/0x8973ae90b38d7a2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d7a28 expref: 19 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596735.823920:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f89600/0x8973ae90b38d7a2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d7a28 expref: 19 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596735.823928:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596735.823954:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c8280050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:3306:x1876527964803328:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596735.823960:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789596735.824032:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964803072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596735.824207:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789596735.824215:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:3306:x1876527964803200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596735.824223:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596735.824227:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d7a3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d7a36 expref: 17 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.824236:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d7a3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d7a36 expref: 17 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.824256:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d7a3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d7a36 expref: 17 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.824265:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596735.824288:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:3306:x1876527964803200:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596735.824295:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789596735.825673:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c570b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876527964802432:192.168.202.44@tcp:104: 00000100:00100000:3.0:1789596735.825685:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5708380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876527964802560:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789596735.825714:0:11679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7b8d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596735.825800:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964803328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596735.825809:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964803200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789596735.828851:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596735.828997:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944848768 00000100:00100000:1.0:1789596735.829007:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944848768 00010000:00010000:1.0:1789596735.829054:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d7a59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d00 expref: 13 pid: 5834 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596735.829084:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 33 00000100:00100000:1.0:1789596735.829092:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5709c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2354:x1876527944848768:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596735.829108:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596735.829114:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d7a59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d00 expref: 13 pid: 5834 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596735.829125:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d7a59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d00 expref: 13 pid: 5834 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596735.829146:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea9021f9e00/0x8973ae90b38d7a59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d00 expref: 13 pid: 5834 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596735.829161:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596735.829223:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5709c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:2354:x1876527944848768:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 131us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596735.829230:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 33 00000100:00100000:0.0:1789596735.833307:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596735.833401:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944848896 00000100:00100000:2.0:1789596735.833411:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944848896 00010000:00010000:2.0:1789596735.833448:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7a52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344cf9 expref: 12 pid: 5834 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596735.833491:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 34 00000100:00100000:2.0:1789596735.833509:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5709500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:2354:x1876527944848896:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596735.833523:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596735.833529:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7a52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344cf9 expref: 12 pid: 5834 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.833542:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7a52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344cf9 expref: 12 pid: 5834 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.833560:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d7a52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344cf9 expref: 12 pid: 5834 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.833578:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7b8d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.833603:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7b8d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.833622:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7b8d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.833630:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7b8d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.833638:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7b8d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.833644:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7b8d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.833650:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031000 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596735.833654:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7b8d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.833662:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7b8d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.833685:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7b8d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596735.833696:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596735.833754:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5709500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+11:2354:x1876527944848896:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 247us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596735.833761:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 34 00010000:00010000:3.0:1789596735.835360:0:11679:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7b8d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596735.835377:0:11679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7b8d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596735.835384:0:11679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8c0031000/0x8973ae90b38d7b8d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596736.032238:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964803712:0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.032291:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964803584:0@lo:400:kworker.0 00000100:00100000:1.0:1789596736.032319:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596736.032353:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964803712 00000100:00100000:0.0:1789596736.032361:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964803712 00000100:00100000:1.0:1789596736.032384:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596736.032390:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964803840:0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.032411:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789596736.032413:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596736.032429:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964803712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596736.032480:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964803456:0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.032491:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964803712:12345-0@lo:400:kworker.0 Request processed in 65us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596736.032512:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596736.032540:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964803456 00000100:00100000:2.0:1789596736.032544:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964803456 00000100:00100000:2.0:1789596736.032566:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789596736.032572:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964803456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596736.032591:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596736.032605:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964803456:12345-0@lo:400:kworker.0 Request processed in 33us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596736.032629:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789596736.032645:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964803584 00000100:00100000:0.0:1789596736.032648:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964803584 00000100:00100000:1.0:1789596736.032656:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964803712:0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.032663:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789596736.032668:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964803584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.032735:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964803584:12345-0@lo:400:kworker.0 Request processed in 66us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596736.032742:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1789596736.032757:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596736.032781:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964803840 00000100:00100000:0.0:1789596736.032784:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964803840 00000100:00100000:0.0:1789596736.033005:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789596736.033012:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964803840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596736.033051:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964803840:12345-0@lo:400:kworker.0 Request processed in 41us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596736.033057:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1789596736.033156:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789596736.033367:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c31e0e00 x1876527964803840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596736.033379:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964803840:0@lo:400:kworker.0 00000100:00100000:3.0:1789596736.033449:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964803584:0@lo:400:kworker.0 00000100:00100000:3.0:1789596736.034893:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964803456:0@lo:400:kworker.0 00000100:00100000:2.0:1789596736.038042:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00010000:2.0:1789596736.411072:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596736.539179:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964803968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596736.539239:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596736.539375:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964803968 00000100:00100000:0.0:1789596736.539382:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964803968 00000100:00100000:0.0:1789596736.539423:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789596736.539430:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964803968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596736.539470:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596736.539513:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964803968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596736.539517:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1789596736.539598:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c5708000 x1876527964803968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596736.539611:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964803968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596737.385951:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596737.386097:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944849024 00000100:00100000:3.0:1789596737.386110:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944849024 00000100:00100000:3.0:1789596737.386172:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 249 00000100:00100000:3.0:1789596737.386183:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+11:5592:x1876527944849024:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596737.386203:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596737.386224:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d7b94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d4d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596737.386267:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d7b94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d4d expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596737.386280:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d7b94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d4d expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596737.386291:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89800, rc 0) 00000100:00100000:3.0:1789596737.386349:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:5592:x1876527944849024:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 169us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596737.386356:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 249 00000100:00100000:1.0:1789596737.393644:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596737.393769:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944849152 00000100:00100000:2.0:1789596737.393780:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944849152 00000100:00100000:2.0:1789596737.393872:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 250 00000100:00100000:2.0:1789596737.393882:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:5592:x1876527944849152:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596737.394201:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:5592:x1876527944849152:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 319us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596737.394209:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 250 00000100:00100000:0.0:1789596737.410069:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596737.410311:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944849280 00000100:00100000:2.0:1789596737.410334:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944849280 00000100:00100000:2.0:1789596737.410406:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 251 00000100:00100000:2.0:1789596737.410419:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:5592:x1876527944849280:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596737.410705:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:5592:x1876527944849280:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 287us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596737.410724:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 251 00000100:00100000:0.0:1789596737.416532:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596737.417880:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944849408 00000100:00100000:3.0:1789596737.417898:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944849408 00000100:00100000:3.0:1789596737.417966:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 252 00000100:00100000:3.0:1789596737.417977:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:9961:x1876527944849408:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789596737.418884:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:9961:x1876527944849408:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 902us (2355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596737.418895:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 252 00000100:00100000:1.0:1789596737.426300:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596737.426725:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944849536 00000100:00100000:2.0:1789596737.426737:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944849536 00000100:00100000:2.0:1789596737.426804:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 253 00000100:00100000:2.0:1789596737.426852:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:9961:x1876527944849536:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789596737.427128:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:9961:x1876527944849536:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 313us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596737.427137:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 253 00000100:00100000:0.0:1789596737.432568:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596737.433035:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944849664 00000100:00100000:3.0:1789596737.433046:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944849664 00000100:00100000:3.0:1789596737.433106:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 254 00000100:00100000:3.0:1789596737.433118:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:5592:x1876527944849664:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596737.433137:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596737.433155:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f89400/0x8973ae90b38d7b9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d54 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596737.433575:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f89400/0x8973ae90b38d7b9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d54 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596737.433604:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f89400/0x8973ae90b38d7b9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d54 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596737.433614:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89400, rc 0) 00000100:00100000:3.0:1789596737.433730:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:5592:x1876527944849664:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 614us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596737.433737:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 254 00010000:00010000:2.0:1789596737.435552:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596737.439041:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596737.439201:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944849792 00000100:00100000:1.0:1789596737.439215:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944849792 00000100:00100000:1.0:1789596737.439282:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 255 00000100:00100000:1.0:1789596737.439293:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c516e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:5592:x1876527944849792:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596737.440278:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c516e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:5592:x1876527944849792:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 981us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596737.440289:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 255 00000100:00100000:1.0:1789596737.453668:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596737.453885:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944849920 00000100:00100000:3.0:1789596737.453894:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944849920 00000100:00100000:3.0:1789596737.453938:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 256 00000100:00100000:3.0:1789596737.453949:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:5592:x1876527944849920:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789596737.454144:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:5592:x1876527944849920:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 195us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596737.454151:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 256 00000100:00100000:1.0:1789596737.460077:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596737.460141:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944850048 00000100:00100000:2.0:1789596737.460152:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944850048 00000100:00100000:2.0:1789596737.460296:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 257 00000100:00100000:2.0:1789596737.460307:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:9964:x1876527944850048:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789596737.460586:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:9964:x1876527944850048:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 281us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596737.460595:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 257 00000100:00100000:0.0:1789596737.463747:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596737.463850:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944850176 00000100:00100000:3.0:1789596737.463860:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944850176 00000100:00100000:3.0:1789596737.464042:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 258 00000100:00100000:3.0:1789596737.464049:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:9964:x1876527944850176:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789596737.464251:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:9964:x1876527944850176:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 201us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596737.464264:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 258 10000000:01000000:2.0:1789596737.690971:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789596737.690979:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea8f66d1800 from 7 10000000:01000000:2.0:1789596737.690985:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789596737.691037:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7ba2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596737.691050:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7ba2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596737.691064:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7ba2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596737.691118:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5782300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964804096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789596737.691211:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596737.691306:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f694ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789596737.691475:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964804096 00000100:00100000:1.0:1789596737.691483:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964804096 00000100:00100000:1.0:1789596737.691540:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789596737.691551:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:5838:x1876527964804096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596737.691565:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596737.691581:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d7ba9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d7ba2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596737.691608:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d7ba9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d7ba2 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596737.691620:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d7ba9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7ba2 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596737.691630:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea9021f9200, rc 0) 00000100:00100000:1.0:1789596737.691685:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964804096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596737.691691:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789596737.692118:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5782300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964804096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596737.692138:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7ba2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7ba9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596737.692163:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7ba2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7ba9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596737.692234:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964804224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596737.692361:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596737.692389:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c56d30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596737.694265:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964804224 00000100:00100000:0.0:1789596737.694283:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964804224 00000100:00100000:0.0:1789596737.694353:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789596737.694363:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964804224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596737.695259:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964804224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 891us (2892us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596737.695272:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789596737.695581:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964804224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596737.695643:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964804352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789596737.695699:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596737.695905:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c56d30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596737.700129:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964804352 00000100:00100000:2.0:1789596737.700148:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964804352 00000100:00100000:2.0:1789596737.700230:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789596737.700243:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964804352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596737.700574:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964804352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 333us (4874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596737.700582:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789596737.700895:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964804352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789596737.703861:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:11692:1876527964804480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596737.703955:0:11692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596737.704021:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c56d3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596737.705866:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964804480 00000100:00100000:0.0:1789596737.705882:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964804480 00000100:00100000:0.0:1789596737.705961:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789596737.705981:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:11692:x1876527964804480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596737.706302:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:11692:x1876527964804480:12345-0@lo:502:llog_process_th.0 Request processed in 323us (2347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596737.706311:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789596737.706622:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:11692:1876527964804480:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789596737.706660:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596737.706669:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596737.706671:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789596737.706679:0:11692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ea8f66d1800 00000020:00000080:3.0:1789596737.706683:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789596737.706795:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:11692:1876527964804608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596737.706879:0:11692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596737.711412:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c56d3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789596737.717472:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964804608 00000100:00100000:1.0:1789596737.717613:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964804608 00000100:00100000:1.0:1789596737.717686:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789596737.717697:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:11692:x1876527964804608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596737.718692:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:11692:x1876527964804608:12345-0@lo:502:llog_process_th.0 Request processed in 993us (11808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596737.718703:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789596737.728290:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:11692:1876527964804608:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789596737.728359:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596737.728368:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596737.728371:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789596737.728377:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789596737.728961:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789596737.728994:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789596737.729007:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7ba2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7ba9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596737.729022:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7ba2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7ba9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596737.729033:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789596737.729036:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea8f9e94000 from 7 10000000:01000000:1.0:1789596737.729039:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789596737.729076:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d7bb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596737.729085:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d7bb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596737.729095:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d7bb0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596737.729125:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964804736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789596737.729200:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596737.729247:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596737.729304:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964804736 00000100:00100000:2.0:1789596737.729312:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964804736 00000100:00100000:2.0:1789596737.729361:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789596737.729370:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:5838:x1876527964804736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596737.729383:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596737.729397:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8ef427600/0x8973ae90b38d7bb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d7bb0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596737.729435:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ef427600/0x8973ae90b38d7bb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d7bb0 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596737.729446:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8ef427600/0x8973ae90b38d7bb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7bb0 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596737.729455:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427600, rc 0) 00000100:00100000:2.0:1789596737.729509:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964804736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596737.729525:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789596737.730205:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964804736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596737.730232:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d7bb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7bb7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596737.730242:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d7bb0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7bb7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596737.730312:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964804864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596737.730346:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596737.730381:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596737.730431:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964804864 00000100:00100000:3.0:1789596737.730436:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964804864 00000100:00100000:3.0:1789596737.730472:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789596737.730489:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964804864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596737.731156:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964804864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 675us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596737.731166:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789596737.731778:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964804864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596737.731850:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964804992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596737.731902:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596737.731932:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596737.732116:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964804992 00000100:00100000:2.0:1789596737.732121:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964804992 00000100:00100000:2.0:1789596737.732154:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789596737.732161:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964804992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596737.732349:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964804992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596737.732356:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789596737.733115:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964804992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789596737.734444:0:11695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:11695:1876527964805120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596737.734548:0:11695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596737.734596:0:11695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c56d3300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596737.734698:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964805120 00000100:00100000:1.0:1789596737.734704:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964805120 00000100:00100000:1.0:1789596737.734765:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789596737.734775:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:11695:x1876527964805120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596737.735326:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:11695:x1876527964805120:12345-0@lo:502:llog_process_th.0 Request processed in 550us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596737.735335:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789596737.735808:0:11695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:11695:1876527964805120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789596737.735878:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596737.735890:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596737.735892:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789596737.735902:0:11695:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ea8f9e94000 00000020:00000080:3.0:1789596737.735904:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789596737.736590:0:11695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:11695:1876527964805248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596737.736644:0:11695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596737.736729:0:11695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c56d3300 going to sleep for 11 seconds 00000100:00100000:2.0:1789596737.740638:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964805248 00000100:00100000:2.0:1789596737.740659:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964805248 00000100:00100000:2.0:1789596737.743932:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789596737.743957:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:11695:x1876527964805248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596737.744249:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:11695:x1876527964805248:12345-0@lo:502:llog_process_th.0 Request processed in 305us (7604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596737.744257:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789596737.744380:0:11695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:11695:1876527964805248:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789596737.744411:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596737.744419:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596737.744426:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789596737.744432:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789596737.751942:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789596737.751979:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789596737.752003:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d7bb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7bb7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596737.752019:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d7bb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7bb7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596737.752030:0:5838:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789596737.752033:0:5838:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea8e4942800 from 7 10000000:01000000:0.0:1789596737.752035:0:5838:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789596737.752075:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d7bbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596737.752083:0:5838:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d7bbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596737.752094:0:5838:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d7bbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596737.752120:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c570b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964805376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789596737.752189:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1789596737.753875:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789596737.754988:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d1052240 going to sleep for 11 seconds 00000100:00100000:1.0:1789596737.760139:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964805376 00000100:00100000:1.0:1789596737.760157:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964805376 00000100:00100000:1.0:1789596737.760229:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789596737.760240:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:5838:x1876527964805376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596737.760688:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596737.760718:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea9021f9600/0x8973ae90b38d7bc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d7bbe expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596737.760755:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea9021f9600/0x8973ae90b38d7bc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d7bbe expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596737.760767:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea9021f9600/0x8973ae90b38d7bc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d7bbe expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596737.760777:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea9021f9600, rc 0) 00000100:00100000:1.0:1789596737.760896:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964805376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 658us (8706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596737.760904:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789596737.761103:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c570b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964805376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596737.761122:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d7bbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7bc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596737.761132:0:5838:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d7bbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7bc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596737.761198:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c570b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964805504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596737.761243:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596737.761279:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d1052240 going to sleep for 11 seconds 00000100:00100000:1.0:1789596737.762345:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964805504 00000100:00100000:1.0:1789596737.762355:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964805504 00000100:00100000:1.0:1789596737.762393:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789596737.762402:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964805504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596737.762842:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964805504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 439us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596737.762851:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789596737.774135:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c570b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964805504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596737.774231:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c570b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964805632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596737.774315:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596737.774363:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d1052240 going to sleep for 11 seconds 00000100:00100000:2.0:1789596737.777953:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964805632 00000100:00100000:2.0:1789596737.777968:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964805632 00000100:00100000:2.0:1789596737.778075:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789596737.778085:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964805632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596737.778333:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:5838:x1876527964805632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 249us (4017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596737.778341:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789596737.778639:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c570b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7810da1-eaae-414b-ba87-f9d6f005a55b:5838:1876527964805632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596737.778897:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c570b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:11698:1876527964805760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596737.778943:0:11698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596737.801052:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6ffb300 going to sleep for 11 seconds 00000100:00100000:3.0:1789596737.801477:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964805760 00000100:00100000:3.0:1789596737.801491:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964805760 00000100:00100000:3.0:1789596737.801849:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789596737.801862:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:11698:x1876527964805760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596737.802135:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:11698:x1876527964805760:12345-0@lo:502:llog_process_th.0 Request processed in 276us (23190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596737.802143:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789596737.802168:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c570b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:11698:1876527964805760:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789596737.802226:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596737.802419:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596737.802422:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789596737.802429:0:11698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ea8e4942800 00000020:00000080:1.0:1789596737.802431:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789596737.802521:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:11698:1876527964805888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596737.802563:0:11698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596737.802589:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789596737.802634:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964805888 00000100:00100000:2.0:1789596737.802640:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964805888 00000100:00100000:2.0:1789596737.802701:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789596737.802786:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:11698:x1876527964805888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596737.802975:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:11698:x1876527964805888:12345-0@lo:502:llog_process_th.0 Request processed in 267us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596737.802982:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789596737.803382:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7810da1-eaae-414b-ba87-f9d6f005a55b:11698:1876527964805888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789596737.803402:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596737.803407:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596737.803409:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789596737.803412:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789596737.803612:0:5838:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789596737.803630:0:5838:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789596737.803640:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d7bbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7bc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596737.803652:0:5838:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d7bbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7bc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596738.459187:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789596738.779543:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789596738.924167:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596738.924228:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596738.924398:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944850304 00000100:00100000:2.0:1789596738.924409:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944850304 00000100:00100000:2.0:1789596738.924471:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 274 00000100:00100000:2.0:1789596738.924482:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2351:x1876527944850304:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596738.924566:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2351:x1876527944850304:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 86us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596738.924574:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 274 00000100:00100000:1.0:1789596738.927877:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944850432 00000100:00100000:1.0:1789596738.927893:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944850432 00000100:00100000:1.0:1789596738.927988:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 104 00000100:00100000:1.0:1789596738.928001:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c570b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2351:x1876527944850432:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596738.928088:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c570b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2351:x1876527944850432:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 91us (3859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596738.928096:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 104 00000100:00080000:0.0:1789596738.933016:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596738.933309:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596738.933357:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596738.933581:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944850688 00000100:00100000:2.0:1789596738.933593:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944850688 00000100:00100000:2.0:1789596738.933678:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 105 00000100:00100000:2.0:1789596738.933690:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2352:x1876527944850688:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596738.933808:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5709180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2352:x1876527944850688:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 121us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596738.933847:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 105 00000100:00080000:0.0:1789596738.933914:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596738.937206:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944850560 00000100:00100000:3.0:1789596738.937220:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944850560 00000100:00100000:3.0:1789596738.937303:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 46 00000100:00100000:3.0:1789596738.937312:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2352:x1876527944850560:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596738.937387:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2352:x1876527944850560:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 77us (4030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596738.937394:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 46 00000100:00080000:0.0:1789596738.937639:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789596739.483189:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596740.507004:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596740.635826:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596740.635849:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964806016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596740.635936:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596740.636037:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964806016 00000100:00100000:0.0:1789596740.636046:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964806016 00000100:00100000:0.0:1789596740.636116:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789596740.636126:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964806016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789596740.636160:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596740.636230:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964806016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596740.636239:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1789596740.636303:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596740.636413:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1789596740.636419:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ea8f67c4000, transno 4294967300 00000100:00100000:3.0:1789596740.636455:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5709880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964806016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596741.147374:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789596741.147841:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876527964806272:0@lo:400:kworker.0 00000100:00100000:1.0:1789596741.148105:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596741.148274:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964806144:0@lo:400:kworker.0 00000100:00100000:1.0:1789596741.148319:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596741.148767:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964806528:0@lo:400:kworker.0 00000100:00100000:2.0:1789596741.148808:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596741.148855:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789596741.148861:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964806400:0@lo:400:kworker.0 00000100:00100000:2.0:1789596741.148883:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596741.148951:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964806144 00000100:00100000:0.0:1789596741.148974:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964806144 00000100:00100000:0.0:1789596741.149034:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789596741.149044:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3307:x1876527964806144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596741.149102:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3307:x1876527964806144:12345-0@lo:400:kworker.0 Request processed in 59us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596741.149109:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789596741.149174:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964806528 00000100:00100000:0.0:1789596741.149179:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964806528 00000100:00100000:0.0:1789596741.149210:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789596741.149217:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964806528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596741.149250:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964806528:12345-0@lo:400:kworker.0 Request processed in 34us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596741.149257:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789596741.149292:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964806656:0@lo:400:kworker.0 00000100:00100000:1.0:1789596741.149652:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964806784:0@lo:400:kworker.0 00000100:00100000:1.0:1789596741.149686:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596741.149759:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964806144:0@lo:400:kworker.0 00000100:00100000:0.0:1789596741.149977:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964806784 00000100:00100000:0.0:1789596741.149983:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964806784 00000100:00100000:0.0:1789596741.150036:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789596741.150044:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964806784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596741.150091:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964806784:12345-0@lo:400:kworker.0 Request processed in 48us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596741.150098:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1789596741.150249:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789596741.150287:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8ff566a00 x1876527964806784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596741.150301:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964806784:0@lo:400:kworker.0 00000100:00100000:2.0:1789596741.150591:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964806528:0@lo:400:kworker.0 00000100:00100000:0.0:1789596741.150663:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596741.150777:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964806272 00000100:00100000:3.0:1789596741.150784:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964806272 00000100:00100000:3.0:1789596741.150843:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964806400 00000100:00100000:3.0:1789596741.150854:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964806400 00000100:00100000:3.0:1789596741.150891:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789596741.150899:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876527964806272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596741.151126:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789596741.151136:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964806400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596741.151196:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964806400:12345-0@lo:400:kworker.0 Request processed in 61us (2310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596741.151202:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789596741.151236:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964806400:0@lo:400:kworker.0 00000100:00080000:2.0:1789596741.151345:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596741.151436:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876527964806272:12345-0@lo:400:kworker.0 Request processed in 537us (3332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596741.151444:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789596741.151527:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876527964806272:0@lo:400:kworker.0 00000100:00100000:2.0:1789596741.151663:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964806656 00000100:00100000:2.0:1789596741.151668:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964806656 00000100:00100000:2.0:1789596741.152238:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789596741.152251:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964806656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596741.152381:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5709880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964806656:12345-0@lo:400:kworker.0 Request processed in 135us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596741.152390:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789596741.152430:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964806656:0@lo:400:kworker.0 00000100:00080000:3.0:1789596741.152606:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789596741.531263:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596741.659486:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789596741.659519:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964806912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596741.659639:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596741.659801:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964806912 00000100:00100000:0.0:1789596741.659812:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964806912 00000100:00100000:0.0:1789596741.659904:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789596741.659916:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964806912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596741.659976:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596741.660042:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964806912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596741.660050:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1789596741.660394:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c5708000 x1876527964806912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596741.660418:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964806912:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789596742.555161:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596743.579089:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596744.056959:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596744.057008:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596744.057172:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944850944 00000100:00100000:1.0:1789596744.057186:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944850944 00000100:00100000:1.0:1789596744.057269:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 109 00000100:00100000:1.0:1789596744.057280:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2351:x1876527944850944:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596744.057387:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5708380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2351:x1876527944850944:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 109us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596744.057394:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 109 00000100:00080000:2.0:1789596744.057848:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596744.058190:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944850816 00000100:00100000:3.0:1789596744.058200:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944850816 00000100:00100000:3.0:1789596744.058245:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 276 00000100:00100000:3.0:1789596744.058253:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2351:x1876527944850816:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596744.058309:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2351:x1876527944850816:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 57us (1364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596744.058316:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 276 00000100:00100000:0.0:1789596744.058666:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596744.058801:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596744.059154:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944851072 00000100:00100000:3.0:1789596744.059170:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944851072 00000100:00100000:3.0:1789596744.059270:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 49 00000100:00100000:3.0:1789596744.059281:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c570aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2352:x1876527944851072:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596744.059363:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c570aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2352:x1876527944851072:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 83us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596744.059371:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 49 00000100:00080000:3.0:1789596744.059516:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596744.059593:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944851200 00000100:00100000:2.0:1789596744.059603:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944851200 00000100:00100000:2.0:1789596744.059680:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 110 00000100:00100000:2.0:1789596744.059697:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c570b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2352:x1876527944851200:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596744.059754:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c570b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2352:x1876527944851200:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 67us (2708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596744.059762:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 110 00000100:00080000:3.0:1789596744.060084:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789596744.603363:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596745.626998:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596745.758263:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596745.758293:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c570a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964807040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596745.758373:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596745.758514:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964807040 00000100:00100000:0.0:1789596745.758523:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964807040 00000100:00100000:0.0:1789596745.758608:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789596745.758619:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964807040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789596745.758672:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596745.758731:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964807040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596745.758738:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789596745.758790:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c570a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964807040:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789596745.760110:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596746.272984:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964807168:0@lo:400:kworker.0 00000100:00100000:2.0:1789596746.273058:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596746.273105:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964807680:0@lo:400:kworker.0 00000100:00100000:2.0:1789596746.273132:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596746.273159:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789596746.273165:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964807296:0@lo:400:kworker.0 00000100:00100000:2.0:1789596746.273186:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596746.273203:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964807808:0@lo:400:kworker.0 00000100:00100000:2.0:1789596746.273225:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596746.273255:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964807424:0@lo:400:kworker.0 00000100:00100000:2.0:1789596746.273291:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596746.273310:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596746.273316:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964807552:0@lo:400:kworker.0 00000100:00100000:2.0:1789596746.273334:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596746.273365:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964807168 00000100:00100000:2.0:1789596746.273373:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964807168 00000100:00100000:2.0:1789596746.273415:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789596746.273423:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964807168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596746.273471:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964807168:12345-0@lo:400:kworker.0 Request processed in 49us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596746.273478:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789596746.273507:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964807680 00000100:00100000:2.0:1789596746.273511:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964807680 00000100:00100000:2.0:1789596746.273555:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964807296 00000100:00100000:2.0:1789596746.273558:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964807296 00000100:00100000:2.0:1789596746.273568:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964807424 00000100:00100000:2.0:1789596746.273570:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964807424 00000100:00100000:2.0:1789596746.273582:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789596746.273588:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964807680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596746.273618:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964807680:12345-0@lo:400:kworker.0 Request processed in 30us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596746.273623:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789596746.273635:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789596746.273641:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964807296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596746.273666:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964807296:12345-0@lo:400:kworker.0 Request processed in 25us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596746.273682:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789596746.273702:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789596746.273708:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964807424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596746.273740:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964807424:12345-0@lo:400:kworker.0 Request processed in 32us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596746.273745:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789596746.273765:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964807808 00000100:00100000:2.0:1789596746.273769:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964807808 00000100:00100000:2.0:1789596746.273793:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964807552 00000100:00100000:2.0:1789596746.273795:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964807552 00000100:00100000:2.0:1789596746.273810:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789596746.273829:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964807808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596746.273857:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964807808:12345-0@lo:400:kworker.0 Request processed in 42us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596746.273862:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789596746.273873:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789596746.273878:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964807552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596746.273903:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964807552:12345-0@lo:400:kworker.0 Request processed in 25us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596746.273909:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789596746.273963:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964807296:0@lo:400:kworker.0 00010000:00080000:2.0:1789596746.273978:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8d0e8d180 x1876527964807808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596746.273989:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964807808:0@lo:400:kworker.0 00000100:00100000:2.0:1789596746.273998:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964807168:0@lo:400:kworker.0 00000100:00100000:2.0:1789596746.274007:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964807680:0@lo:400:kworker.0 00000100:00080000:2.0:1789596746.274040:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789596746.274044:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596746.274065:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964807552:0@lo:400:kworker.0 00000100:00100000:2.0:1789596746.274075:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964807424:0@lo:400:kworker.0 00010000:00010000:2.0:1789596746.651552:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596746.779203:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596746.779232:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c570a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964807936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596746.779309:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596746.779448:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964807936 00000100:00100000:0.0:1789596746.779459:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964807936 00000100:00100000:0.0:1789596746.779514:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789596746.779530:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964807936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596746.779571:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596746.779656:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964807936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596746.779675:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1789596746.779903:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c570a680 x1876527964807936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596746.779923:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c570a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964807936:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789596747.675293:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596748.699628:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789596749.019475:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789596749.158537:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596749.158585:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596749.158719:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944851456 00000100:00100000:3.0:1789596749.158732:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944851456 00000100:00100000:3.0:1789596749.158802:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944851712 00000100:00100000:3.0:1789596749.158806:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944851712 00000100:00100000:3.0:1789596749.158864:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 114 00000100:00100000:3.0:1789596749.158875:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c570ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2352:x1876527944851456:12345-192.168.202.44@tcp:400:kworker.0 00000100:00080000:1.0:1789596749.159007:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596749.159074:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 115 00000100:00100000:2.0:1789596749.159085:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c570bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2352:x1876527944851712:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596749.160403:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c570ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2352:x1876527944851456:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 1518us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596749.160417:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 114 00000100:00100000:0.0:1789596749.162202:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596749.162253:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596749.162342:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944851328 00000100:00100000:1.0:1789596749.162352:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944851328 00000100:00100000:1.0:1789596749.162422:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 278 00000100:00100000:1.0:1789596749.162432:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2352:x1876527944851328:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596749.162495:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2352:x1876527944851328:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 64us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596749.162502:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 278 00000100:00100000:3.0:1789596749.164101:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944851584 00000100:00100000:3.0:1789596749.164113:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944851584 00000100:00100000:3.0:1789596749.164191:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 52 00000100:00100000:3.0:1789596749.164199:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c570a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2352:x1876527944851584:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596749.164269:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c570a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2352:x1876527944851584:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 70us (2015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596749.164276:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 52 00000100:00080000:1.0:1789596749.167850:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596749.169239:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c570bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2352:x1876527944851712:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 10145us (10641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596749.169255:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 115 00010000:00010000:2.0:1789596749.723986:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596750.747228:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596750.878967:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596750.878987:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c570a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964808064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596750.879044:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596750.879142:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964808064 00000100:00100000:0.0:1789596750.879149:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964808064 00000100:00100000:0.0:1789596750.879203:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789596750.879209:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964808064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789596750.879237:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596750.879271:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964808064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596750.879276:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789596750.879323:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596750.879351:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c570a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964808064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596751.387168:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964808192:0@lo:400:kworker.0 00000100:00100000:1.0:1789596751.387224:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c570a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876527964808320:0@lo:400:kworker.0 00000100:00100000:3.0:1789596751.387246:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596751.387256:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596751.387306:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f7495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964808704:0@lo:400:kworker.0 00000100:00100000:2.0:1789596751.387317:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f7496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964808576:0@lo:400:kworker.0 00000100:00100000:2.0:1789596751.387344:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596751.387347:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596751.387397:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964808192 00000100:00100000:0.0:1789596751.387406:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964808192 00000100:00100000:0.0:1789596751.387452:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789596751.387461:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964808192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596751.387791:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f7495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964808832:0@lo:400:kworker.0 00000100:00100000:3.0:1789596751.390092:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964808320 00000100:00100000:3.0:1789596751.390120:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964808320 00000100:00100000:3.0:1789596751.390188:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964808704 00000100:00100000:3.0:1789596751.390192:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964808704 00000100:00100000:3.0:1789596751.390234:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789596751.390244:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876527964808320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596751.390327:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876527964808320:12345-0@lo:400:kworker.0 Request processed in 85us (3068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596751.390334:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789596751.390351:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789596751.390357:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964808704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596751.390392:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964808704:12345-0@lo:400:kworker.0 Request processed in 35us (3043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596751.390398:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1789596751.390418:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596751.390452:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f7495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964808704:0@lo:400:kworker.0 00000100:00100000:3.0:1789596751.390499:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f7496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964808448:0@lo:400:kworker.0 00000100:00100000:3.0:1789596751.390532:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596751.390574:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964808448 00000100:00100000:3.0:1789596751.390578:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964808448 00000100:00100000:3.0:1789596751.390604:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789596751.390610:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964808448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596751.390656:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964808448:12345-0@lo:400:kworker.0 Request processed in 46us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596751.390662:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1789596751.390691:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596751.390709:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f7496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964808448:0@lo:400:kworker.0 00000100:00100000:3.0:1789596751.390813:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964808576 00000100:00100000:3.0:1789596751.390843:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964808576 00000100:00100000:3.0:1789596751.390876:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789596751.390884:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964808576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596751.390919:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964808576:12345-0@lo:400:kworker.0 Request processed in 36us (3575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596751.390925:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789596751.392085:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964808192:12345-0@lo:400:kworker.0 Request processed in 4619us (4833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596751.392097:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789596751.392274:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5708000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964808192:0@lo:400:kworker.0 00000100:00100000:2.0:1789596751.396296:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f7496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964808576:0@lo:400:kworker.0 00000100:00100000:1.0:1789596751.396743:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596751.396806:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c570a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876527964808320:0@lo:400:kworker.0 00000100:00100000:3.0:1789596751.396914:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964808832 00000100:00100000:3.0:1789596751.396922:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964808832 00000100:00100000:3.0:1789596751.396996:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789596751.397006:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964808832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596751.397077:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964808832:12345-0@lo:400:kworker.0 Request processed in 73us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596751.397084:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1789596751.397159:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8f7495500 x1876527964808832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596751.397171:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f7495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964808832:0@lo:400:kworker.0 00000100:00080000:0.0:1789596751.397288:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789596751.771000:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596751.899780:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f7494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964808960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596751.899876:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596751.900668:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964808960 00000100:00100000:0.0:1789596751.900680:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964808960 00000100:00100000:0.0:1789596751.900735:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789596751.900760:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964808960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596751.900799:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596751.900891:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964808960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596751.900909:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789596751.901211:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8f7494000 x1876527964808960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596751.901235:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f7494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964808960:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789596752.794977:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596753.819640:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596754.279127:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596754.279170:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596754.279253:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944851840 00000100:00100000:0.0:1789596754.279264:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944851840 00000100:00100000:3.0:1789596754.279309:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944851968 00000100:00100000:3.0:1789596754.279316:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944851968 00000100:00100000:0.0:1789596754.279321:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 280 00000100:00100000:0.0:1789596754.279332:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2351:x1876527944851840:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596754.279390:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 119 00000100:00100000:0.0:1789596754.279399:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2351:x1876527944851840:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 68us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596754.279402:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2351:x1876527944851968:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596754.279408:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 280 00000100:00100000:3.0:1789596754.279459:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2351:x1876527944851968:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 60us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596754.279479:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 119 00000100:00080000:2.0:1789596754.279554:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596754.289740:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596754.289895:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596754.290231:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944852096 00000100:00100000:2.0:1789596754.290243:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944852096 00000100:00080000:1.0:1789596754.290305:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596754.290331:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 19 00000100:00100000:3.0:1789596754.290430:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944852224 00000100:00100000:3.0:1789596754.290436:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944852224 00000100:00100000:3.0:1789596754.290494:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 120 00000100:00100000:3.0:1789596754.290504:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2351:x1876527944852224:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596754.290581:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2351:x1876527944852224:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 79us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596754.290589:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 120 00000100:00080000:3.0:1789596754.290619:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596754.290729:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2350:x1876527944852096:12345-192.168.202.44@tcp:9:kworker.0 00000020:00000080:2.0:1789596754.290756:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7b01 00000100:00080000:2.0:1789596754.290766:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9ea8f6591800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789596754.290807:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1789596754.290920:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596754.291086:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+2:2350:x1876527944852096:12345-192.168.202.44@tcp:9:kworker.0 Request processed in 745us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596754.294064:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 19 00010000:00010000:2.0:1789596754.843084:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596755.867205:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596755.995292:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596755.995334:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f7494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964809088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596755.995431:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596755.995657:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964809088 00000100:00100000:0.0:1789596755.995668:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964809088 00000100:00100000:0.0:1789596755.995744:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789596755.995754:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964809088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789596755.995809:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596755.995898:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964809088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596755.995906:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789596755.995964:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f7494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964809088:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789596755.996134:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1789596756.124636:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1fdd0e7b-fe25-4537-b350-ae6aecfab059 00000020:00000080:1.0:1789596756.124649:0:6719:0:(genops.c:885:class_export_put()) final put ffff9ea8f6595000/1fdd0e7b-fe25-4537-b350-ae6aecfab059 00000020:00000080:3.0:1789596756.127249:0:470:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8f6595000/1fdd0e7b-fe25-4537-b350-ae6aecfab059 for lustre-OST0000 00000020:00000080:3.0:1789596756.127326:0:470:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea8f6591800 for lustre-OST0000 00000100:00100000:3.0:1789596756.507187:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964809472:0@lo:400:kworker.0 00000100:00100000:3.0:1789596756.507286:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596756.507369:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596756.507377:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964809600:0@lo:400:kworker.0 00000100:00100000:3.0:1789596756.507406:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596756.507450:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964809472 00000100:00100000:3.0:1789596756.507460:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964809472 00000100:00100000:3.0:1789596756.507533:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789596756.507587:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964809472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596756.507653:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964809472:12345-0@lo:400:kworker.0 Request processed in 78us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596756.507661:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789596756.507690:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964809600 00000100:00100000:3.0:1789596756.507694:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964809600 00000100:00100000:3.0:1789596756.507720:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789596756.507726:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964809600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596756.507757:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964809600:12345-0@lo:400:kworker.0 Request processed in 31us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596756.507763:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789596756.507780:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596756.507873:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964809600:0@lo:400:kworker.0 00000100:00100000:3.0:1789596756.507888:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964809472:0@lo:400:kworker.0 00000100:00100000:2.0:1789596756.508034:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876527964809344:0@lo:400:kworker.0 00000100:00100000:2.0:1789596756.508073:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596756.508102:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964809856:0@lo:400:kworker.0 00000100:00100000:2.0:1789596756.508125:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596756.508148:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789596756.508155:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964809216:0@lo:400:kworker.0 00000100:00100000:2.0:1789596756.508187:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596756.508214:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876527964809728:0@lo:400:kworker.0 00000100:00100000:2.0:1789596756.508238:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596756.508272:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964809856 00000100:00100000:2.0:1789596756.508277:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964809856 00000100:00100000:2.0:1789596756.508314:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789596756.508322:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964809856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596756.508359:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964809856:12345-0@lo:400:kworker.0 Request processed in 39us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596756.508365:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789596756.508408:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964809216 00000100:00100000:2.0:1789596756.508424:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964809216 00000100:00100000:2.0:1789596756.508457:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789596756.508463:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3307:x1876527964809216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596756.508493:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3307:x1876527964809216:12345-0@lo:400:kworker.0 Request processed in 31us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596756.508499:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789596756.508530:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964809344 00000100:00100000:2.0:1789596756.508534:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964809344 00000100:00100000:2.0:1789596756.508553:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964809728 00000100:00100000:2.0:1789596756.508556:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964809728 00000100:00100000:2.0:1789596756.508574:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789596756.508595:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876527964809344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596756.508627:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876527964809344:12345-0@lo:400:kworker.0 Request processed in 33us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596756.508632:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789596756.508643:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789596756.508648:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876527964809728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596756.508674:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876527964809728:12345-0@lo:400:kworker.0 Request processed in 26us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596756.508680:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789596756.508715:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964809216:0@lo:400:kworker.0 00000100:00100000:2.0:1789596756.508726:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876527964809728:0@lo:400:kworker.0 00000100:00100000:2.0:1789596756.508734:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876527964809344:0@lo:400:kworker.0 00010000:00080000:2.0:1789596756.508747:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c37a8000 x1876527964809856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596756.508772:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964809856:0@lo:400:kworker.0 00000100:00080000:3.0:1789596756.508980:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789596756.508987:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789596756.896700:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596757.019273:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964809984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596757.019432:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596757.021003:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964809984 00000100:00100000:0.0:1789596757.021031:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964809984 00000100:00100000:0.0:1789596757.021369:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789596757.021384:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964809984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596757.021439:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596757.021551:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964809984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596757.021559:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1789596757.024126:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c37aaa00 x1876527964809984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596757.024163:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964809984:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789596757.915084:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596758.939148:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789596759.269792:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789596759.400928:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596759.400960:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596759.401052:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596759.401109:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944852352 00000100:00100000:1.0:1789596759.401119:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944852352 00000100:00100000:1.0:1789596759.401177:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 282 00000100:00100000:1.0:1789596759.401188:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2354:x1876527944852352:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596759.401254:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2354:x1876527944852352:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 69us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596759.401262:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 282 00000100:00100000:2.0:1789596759.403385:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944852608 00000100:00100000:2.0:1789596759.403399:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944852608 00000100:00100000:2.0:1789596759.403513:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944852480 00000100:00100000:2.0:1789596759.403518:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944852480 00000100:00080000:0.0:1789596759.403571:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596759.404431:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 124 00000100:00100000:3.0:1789596759.404447:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2354:x1876527944852608:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596759.404542:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2354:x1876527944852608:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 100us (3580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596759.404559:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 124 00000100:00100000:3.0:1789596759.404579:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 125 00000100:00100000:3.0:1789596759.404587:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2354:x1876527944852480:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596759.404778:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2354:x1876527944852480:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 191us (3725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596759.404785:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 125 00010000:00010000:1.0:1789596759.964842:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789596760.701397:0:11864:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 18:12:39 (1789596759) 00010000:00010000:2.0:1789596760.989013:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596761.115564:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964810112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596761.115673:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596761.115862:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964810112 00000100:00100000:3.0:1789596761.115875:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964810112 00000100:00100000:3.0:1789596761.115984:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789596761.116007:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964810112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596761.116054:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596761.116122:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964810112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596761.116130:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789596761.116371:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964810112:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789596761.116639:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596761.627411:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964810496:0@lo:400:kworker.0 00000100:00100000:0.0:1789596761.627479:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964810240:0@lo:400:kworker.0 00000100:00100000:1.0:1789596761.627511:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596761.627587:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596761.627612:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596761.627625:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964810624:0@lo:400:kworker.0 00000100:00100000:0.0:1789596761.627643:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964810752:0@lo:400:kworker.0 00000100:00100000:1.0:1789596761.627662:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596761.627695:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596761.627741:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596761.627750:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964810368:0@lo:400:kworker.0 00000100:00100000:1.0:1789596761.627792:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964810752 00000100:00100000:0.0:1789596761.627799:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596761.628039:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964810752 00000100:00100000:3.0:1789596761.628196:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964810496 00000100:00100000:1.0:1789596761.628205:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789596761.628209:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964810496 00000100:00100000:1.0:1789596761.628218:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964810752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596761.628276:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964810624 00000100:00100000:3.0:1789596761.628283:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964810624 00000100:00100000:1.0:1789596761.628284:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964810752:12345-0@lo:400:kworker.0 Request processed in 69us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596761.628295:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789596761.628318:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964810368 00000100:00100000:3.0:1789596761.628324:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964810368 00000100:00100000:1.0:1789596761.628357:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789596761.628370:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964810496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596761.628377:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789596761.628392:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876527964810624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596761.628424:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964810496:12345-0@lo:400:kworker.0 Request processed in 56us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596761.628432:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789596761.628462:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789596761.628470:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876527964810624:12345-0@lo:400:kworker.0 Request processed in 79us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596761.628479:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789596761.628580:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964810240 00000100:00100000:2.0:1789596761.628588:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964810240 00000100:00100000:2.0:1789596761.628634:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00080000:0.0:1789596761.628641:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596761.628644:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964810240:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789596761.628650:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596761.628699:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964810240:12345-0@lo:400:kworker.0 Request processed in 57us (1117us total) trans 0 rc 0/0 00010000:00080000:0.0:1789596761.628703:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8fa1c4380 x1876527964810752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789596777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596761.628715:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789596761.628736:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964810752:0@lo:400:kworker.0 00000100:00100000:0.0:1789596761.628774:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff566a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964810240:0@lo:400:kworker.0 00000100:00100000:2.0:1789596761.629222:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964810624:0@lo:400:kworker.0 00000100:00100000:2.0:1789596761.629240:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964810496:0@lo:400:kworker.0 00000100:00100000:1.0:1789596761.629369:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964810368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596761.629422:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964810368:12345-0@lo:400:kworker.0 Request processed in 953us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596761.629429:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789596761.629487:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964810368:0@lo:400:kworker.0 00010000:00010000:0.0:1789596762.011164:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596762.140429:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964810880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596762.140501:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596762.140843:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964810880 00000100:00100000:3.0:1789596762.140852:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964810880 00000100:00100000:3.0:1789596762.140908:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789596762.140918:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964810880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789596762.140952:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596762.141032:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964810880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596762.141039:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1789596762.141201:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c37a9880 x1876527964810880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596778 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596762.141219:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964810880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596762.496219:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596762.496632:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944852736 00000100:00100000:0.0:1789596762.496644:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944852736 00000100:00100000:0.0:1789596762.496733:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 32 00000100:00100000:0.0:1789596762.496743:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:10235:x1876527944852736:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789596762.496766:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596762.496791:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7bcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d5b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.496911:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7bd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.496936:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.496952:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596762.496991:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789596762.496996:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789596762.497054:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.497080:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7bcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d5b expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.497117:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d5b expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.497126:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8d55e5c00) 00010000:00010000:0.0:1789596762.497130:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789596762.497134:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030e00, rc 0) 00000100:00100000:0.0:1789596762.497196:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:10235:x1876527944852736:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 455us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596762.497203:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 32 00000100:00080000:1.0:1789596762.497435:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596762.504603:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596762.504799:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944852864 00000100:00100000:2.0:1789596762.504810:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944852864 00000100:00100000:2.0:1789596762.504904:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 33 00000100:00100000:2.0:1789596762.504915:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:10236:x1876527944852864:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596762.504961:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596762.504984:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7bda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d62 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505061:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7be1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505076:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7be1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505089:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7be1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505105:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7be8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505113:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7be8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505119:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7be8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505475:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427200/0x8973ae90b38d7bef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505497:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427200/0x8973ae90b38d7bef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505505:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427200/0x8973ae90b38d7bef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596762.505545:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789596762.505555:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789596762.505582:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427200/0x8973ae90b38d7bef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505593:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7be1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505600:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7be1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505607:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7be1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505613:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596762.505617:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7be1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505626:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7be1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505637:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8d55e5c00) 00010000:00010000:2.0:1789596762.505640:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596762.505644:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7be1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505650:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7be1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505661:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7be8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505667:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7be8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505681:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7be8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505686:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596762.505689:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7be8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505694:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7be8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505701:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ea8e0eea800) 00010000:00010000:2.0:1789596762.505703:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596762.505707:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7be8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505712:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7be8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505770:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7bda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d62 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505784:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427200/0x8973ae90b38d7bef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d62 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596762.505791:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ea8e0eeaf00) 00010000:00010000:2.0:1789596762.505793:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789596762.505795:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427200, rc 0) 00000100:00100000:2.0:1789596762.505912:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:10236:x1876527944852864:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 1000us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596762.505929:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 33 00000100:00100000:1.0:1789596762.524959:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596762.526413:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944853120 00000100:00100000:0.0:1789596762.526429:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944853120 00000100:00100000:0.0:1789596762.526635:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 34 00000100:00100000:0.0:1789596762.526647:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:10236:x1876527944853120:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789596762.526670:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596762.526693:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7bf6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d69 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.526796:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7bfd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.526811:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7bfd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.526840:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7bfd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.526868:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7c04 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.526876:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7c04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.526883:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7c04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.529747:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d7c0b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.529773:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d7c0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.529786:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d7c0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596762.529799:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789596762.531198:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7bfd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.531213:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7bfd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.531221:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7bfd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.531227:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596762.531231:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7bfd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.531325:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7bfd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.532206:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ea8e0eeaf00) 00010000:00010000:0.0:1789596762.532213:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596762.532221:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7bfd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.532229:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7bfd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.532250:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7c04 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.532267:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7c04 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.532273:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7c04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.532279:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596762.532282:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7c04 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.532289:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7c04 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.532299:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ea8d55e5a00) 00010000:00010000:0.0:1789596762.532301:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596762.532304:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7c04 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.532326:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7c04 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.533933:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7bf6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d69 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.533959:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d7c0b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d69 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596762.533968:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ea8d55e5800) 00010000:00010000:0.0:1789596762.533971:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596762.533974:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030800, rc 0) 00000100:00100000:0.0:1789596762.534242:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:10236:x1876527944853120:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 7595us (9291us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789596762.534261:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 34 00000100:00100000:2.0:1789596762.553034:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596762.553111:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944853248 00000100:00100000:0.0:1789596762.553123:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944853248 00000100:00100000:0.0:1789596762.553192:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 35 00000100:00100000:0.0:1789596762.553203:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:10236:x1876527944853248:12345-192.168.202.44@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789596762.553322:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:10236:x1876527944853248:12345-192.168.202.44@tcp:59:lhsmtool_posix.0 Request processed in 120us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596762.553330:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 35 00010000:00010000:1.0:1789596763.038731:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789596763.362108:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789596764.058985:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596764.228423:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596764.228650:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944853376 00000100:00100000:2.0:1789596764.228661:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944853376 00000100:00100000:2.0:1789596764.228735:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 36 00000100:00100000:2.0:1789596764.228747:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:10278:x1876527944853376:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:2.0:1789596764.228768:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596764.228842:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7c19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d70 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789596764.229058:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789596764.229110:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7c20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229127:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7c20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229139:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7c20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229155:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229162:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229169:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229387:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7c20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229396:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7c20 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229403:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7c20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229409:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596764.229413:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7c20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229421:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7c20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229435:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8d55e5c00) 00010000:00010000:2.0:1789596764.229439:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596764.229443:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7c20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229449:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7c20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229460:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229717:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229723:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229736:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596764.229739:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229745:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229754:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ea8e0eea800) 00010000:00010000:2.0:1789596764.229756:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596764.229759:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229765:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229800:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7c19 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d70 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.229810:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8d55e5c00) 00010000:00010000:2.0:1789596764.229812:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596764.230010:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7c19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d70 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.230022:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426600, rc 0) 00000100:00100000:1.0:1789596764.233455:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:10278:x1876527944853376:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 4699us (5031us total) trans 0 rc 301/301 00000100:00100000:1.0:1789596764.233543:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 36 00000100:00100000:1.0:1789596764.240807:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596764.241075:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944853632 00000100:00100000:2.0:1789596764.241088:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944853632 00000100:00100000:2.0:1789596764.241159:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 37 00000100:00100000:2.0:1789596764.241170:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:10278:x1876527944853632:12345-192.168.202.44@tcp:36:lfs.0 00010000:00010000:2.0:1789596764.241263:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596764.241291:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7bd3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d5b expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.241313:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8d55e5c00) 00010000:00010000:2.0:1789596764.241324:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596764.241554:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7c2e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.241570:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7c2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.241581:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7c2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.241594:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c35 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.241602:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.241608:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596764.242851:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789596764.242866:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7c2e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.242875:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7c2e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.242883:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7c2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.242897:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596764.242902:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7c2e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.243309:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7c2e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.243328:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea800) 00010000:00010000:2.0:1789596764.243331:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596764.243337:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7c2e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.243344:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7c2e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596764.243364:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fb556b9 reply state 000000002d8e20db transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596764.243374:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789596764.243897:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+10:10278:x1876527944853632:12345-192.168.202.44@tcp:36:lfs.0 Request processed in 2724us (3097us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789596764.243915:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 37 00010000:00010000:1.0:1789596764.248847:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c35 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.248880:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c35 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.248889:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c35 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.248896:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596764.248902:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c35 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.248911:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c35 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.248927:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ea8e0eeac00) 00010000:00010000:1.0:1789596764.248931:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596764.248936:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c35 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.248942:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7c35 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596764.356398:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596764.356728:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944853760 00000100:00100000:2.0:1789596764.356740:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944853760 00000100:00100000:2.0:1789596764.356811:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 38 00000100:00100000:2.0:1789596764.356847:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:10286:x1876527944853760:12345-192.168.202.44@tcp:101:lctl.0 00010000:00010000:2.0:1789596764.356875:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596764.356901:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7c3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d77 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.357012:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7c43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.357028:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.357041:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596764.357080:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789596764.357084:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789596764.357129:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.357155:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7c3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d77 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.357175:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7c43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d77 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.357185:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea800) 00010000:00010000:2.0:1789596764.357188:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789596764.357191:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426e00, rc 0) 00000100:00100000:2.0:1789596764.357261:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+10:10286:x1876527944853760:12345-192.168.202.44@tcp:101:lctl.0 Request processed in 416us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596764.357268:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 38 00000100:00100000:3.0:1789596764.411989:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596764.412250:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944853888 00000100:00100000:1.0:1789596764.412262:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944853888 00000100:00100000:1.0:1789596764.412338:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 39 00000100:00100000:1.0:1789596764.412349:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+10:10292:x1876527944853888:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:1.0:1789596764.412381:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596764.412404:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9800/0x8973ae90b38d7c4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d7e expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.412514:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8800/0x8973ae90b38d7c51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.412530:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8800/0x8973ae90b38d7c51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.412542:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8800/0x8973ae90b38d7c51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.412557:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7c58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.412565:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7c58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.412572:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7c58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.412691:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32400/0x8973ae90b38d7c5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.412700:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32400/0x8973ae90b38d7c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.412708:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32400/0x8973ae90b38d7c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596764.412737:0:10902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789596764.412742:0:10902:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789596764.412782:0:10902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32400/0x8973ae90b38d7c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.412806:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8800/0x8973ae90b38d7c51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.412813:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8800/0x8973ae90b38d7c51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.412865:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8800/0x8973ae90b38d7c51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.412872:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f8800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596764.412877:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8800/0x8973ae90b38d7c51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.412886:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8800/0x8973ae90b38d7c51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.412901:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea800) 00010000:00010000:1.0:1789596764.413417:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596764.413424:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8800/0x8973ae90b38d7c51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.413432:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8800/0x8973ae90b38d7c51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.413449:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7c58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.413454:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7c58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.413515:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7c58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.413530:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f8400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596764.413533:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7c58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.413541:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7c58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.413551:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ea8c36d5f00) 00010000:00010000:1.0:1789596764.413554:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596764.413557:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7c58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.413564:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8400/0x8973ae90b38d7c58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.413601:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9800/0x8973ae90b38d7c4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d7e expref: 12 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.413616:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32400/0x8973ae90b38d7c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d7e expref: 11 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.413624:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:1.0:1789596764.413626:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789596764.413628:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32400, rc 0) 00000100:00100000:2.0:1789596764.414595:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+11:10292:x1876527944853888:12345-192.168.202.44@tcp:101:bash.0 Request processed in 2240us (2609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596764.414618:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 39 00000100:00100000:2.0:1789596764.426647:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596764.426739:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944854144 00000100:00100000:3.0:1789596764.426750:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944854144 00000100:00100000:3.0:1789596764.426862:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 40 00000100:00100000:3.0:1789596764.427057:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+11:10292:x1876527944854144:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:3.0:1789596764.427079:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596764.427102:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d7c66 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d85 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.427248:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7c6d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.427264:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7c6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.427275:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7c6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.427337:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7c74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.427346:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7c74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.427353:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7c74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789596764.428027:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789596764.428218:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7c7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.428230:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.428239:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7c7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.428276:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7c6d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.428284:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7c6d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.428291:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7c6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.428297:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596764.428302:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7c6d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.428310:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7c6d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.428322:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:3.0:1789596764.428325:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596764.428330:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7c6d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.428351:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7c6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789596764.428366:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e90850b2 reply state 00000000355b2a4e transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7c74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596764.428374:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789596764.428407:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d7c66 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d85 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.428422:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7c7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d85 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.428430:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d1438900) 00010000:00010000:3.0:1789596764.428432:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596764.428434:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89600, rc 0) 00000100:00100000:3.0:1789596764.428531:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:10292:x1876527944854144:12345-192.168.202.44@tcp:101:bash.0 Request processed in 1657us (1891us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789596764.432381:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 40 00010000:00010000:1.0:1789596764.432811:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7c74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.432847:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7c74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.432876:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7c74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.432882:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596764.432887:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7c74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.432896:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7c74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.432915:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ea8d1438300) 00010000:00010000:1.0:1789596764.432919:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596764.432925:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7c74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.432932:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7c74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596764.436803:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596764.436934:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944854272 00000100:00100000:1.0:1789596764.436947:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944854272 00000100:00100000:1.0:1789596764.436990:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 20 00000100:00100000:1.0:1789596764.436997:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1876527944854272:12345-192.168.202.44@tcp:8:bash.0 00010000:00080000:1.0:1789596764.437031:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp t0 exp 0000000000000000 cur 349 last 0 00000020:00000080:1.0:1789596764.437060:0:6692:0:(genops.c:1384:class_connect()) connect: client 1fdd0e7b-fe25-4537-b350-ae6aecfab059, cookie 0x8973ae90b38d7c89 00002000:00100000:1.0:1789596764.437070:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1fdd0e7b-fe25-4537-b350-ae6aecfab059/ffff9ea8c3ee9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789596764.437089:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789596764.437288:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789596764.437325:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9ea8c3eec000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789596764.437393:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2350:x1876527944854272:12345-192.168.202.44@tcp:8:bash.0 Request processed in 395us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596764.437401:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 20 00000100:00100000:0.0:1789596764.439743:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596764.439889:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944854400 00000100:00100000:1.0:1789596764.439900:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944854400 00000100:00100000:1.0:1789596764.439966:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 21 00000100:00100000:1.0:1789596764.439975:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:0:x1876527944854400:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:1.0:1789596764.439990:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596764.440011:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ac4025c/0x8973ae90b38d7c90 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d8c expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789596764.440035:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789596764.440051:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1789596764.440054:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596764.440061:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ac4025c/0x8973ae90b38d7c90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d8c expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.440084:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009ac4025c/0x8973ae90b38d7c90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d8c expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.440094:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a33800, rc 0) 00000100:00100000:1.0:1789596764.440140:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:0:x1876527944854400:12345-192.168.202.44@tcp:101:bash.0 Request processed in 167us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596764.440147:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 21 00000100:00080000:0.0:1789596764.440565:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596764.443935:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596764.444066:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944854528 00000100:00100000:1.0:1789596764.444078:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944854528 00000100:00100000:1.0:1789596764.444154:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 22 00000100:00100000:1.0:1789596764.444165:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:10292:x1876527944854528:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:1.0:1789596764.444189:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596764.444209:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c60ba19c/0x8973ae90b38d7c97 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d93 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.444242:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009ac4025c/0x8973ae90b38d7c90 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d8c expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.444252:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596764.444258:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596764.444263:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c60ba19c/0x8973ae90b38d7c97 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d93 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.444314:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009ac4025c/0x8973ae90b38d7c90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d8c expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.444330:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009ac4025c/0x8973ae90b38d7c90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d8c expref: 8 pid: 6695 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596764.444344:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa661180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1876527964811008:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789596764.444456:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c81ab840 going to sleep for 11 seconds 00000100:00100000:3.0:1789596764.448044:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596764.448104:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa661180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1876527964811008:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596764.448143:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c60ba19c/0x8973ae90b38d7c97 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d93 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.448186:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32c00, rc 0) 00000100:00100000:1.0:1789596764.448249:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:10292:x1876527944854528:12345-192.168.202.44@tcp:101:bash.0 Request processed in 4086us (4324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596764.448258:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 22 00000100:00100000:2.0:1789596764.448794:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944854656 00000100:00100000:2.0:1789596764.448802:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944854656 00010000:00010000:2.0:1789596764.448863:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009ac4025c/0x8973ae90b38d7c90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d8c expref: 8 pid: 6695 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596764.448898:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 35 00000100:00100000:2.0:1789596764.448905:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2353:x1876527944854656:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596764.448916:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596764.448936:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009ac4025c/0x8973ae90b38d7c90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d8c expref: 8 pid: 6695 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.448945:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009ac4025c/0x8973ae90b38d7c90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d8c expref: 8 pid: 6695 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.448964:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ac4025c/0x8973ae90b38d7c90 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d8c expref: 8 pid: 6695 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.448976:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596764.448979:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596764.448984:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c60ba19c/0x8973ae90b38d7c97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d93 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.449003:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c60ba19c/0x8973ae90b38d7c97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d93 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.449030:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c60ba19c/0x8973ae90b38d7c97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d93 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596764.449040:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa1c4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1876527964811136:192.168.202.44@tcp:105: 00000100:00100000:2.0:1789596764.449094:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c313d900 going to sleep for 11 seconds 00000100:00100000:0.0:1789596764.456168:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa1c4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1876527964811136:192.168.202.44@tcp:105: 00010000:00010000:0.0:1789596764.456212:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596764.456269:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2353:x1876527944854656:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 7362us (8233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596764.456290:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 35 00000100:00100000:2.0:1789596764.456350:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596764.456447:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944854912 00000100:00100000:1.0:1789596764.456454:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944854912 00000100:00100000:1.0:1789596764.456582:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 6 00000100:00100000:1.0:1789596764.456600:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:10292:x1876527944854912:12345-192.168.202.44@tcp:35:bash.0 00000100:00100000:1.0:1789596764.456952:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:10292:x1876527944854912:12345-192.168.202.44@tcp:35:bash.0 Request processed in 359us (600us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789596764.456959:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 6 00000100:00100000:0.0:1789596764.533438:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596764.533497:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596764.533635:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944855168 00000100:00100000:2.0:1789596764.533647:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944855168 00000100:00100000:2.0:1789596764.533738:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 129 00000100:00100000:2.0:1789596764.533749:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2353:x1876527944855168:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596764.533858:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2353:x1876527944855168:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 110us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596764.533867:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 129 00000100:00080000:0.0:1789596764.534222:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596764.534892:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944855040 00000100:00100000:3.0:1789596764.534901:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944855040 00000100:00100000:3.0:1789596764.534955:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 284 00000100:00100000:3.0:1789596764.534965:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2353:x1876527944855040:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596764.535028:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2353:x1876527944855040:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 64us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596764.535035:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 284 00000100:00100000:0.0:1789596764.537426:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596764.538154:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944855424 00000100:00100000:1.0:1789596764.538166:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944855424 00000100:00100000:1.0:1789596764.538318:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 41 00000100:00100000:1.0:1789596764.538330:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:10302:x1876527944855424:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:1.0:1789596764.538357:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596764.538379:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7c9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344d9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596764.538547:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789596764.538691:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7c9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d9a expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.538705:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea800) 00010000:00010000:1.0:1789596764.538722:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789596764.538729:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7c9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d9a expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.538745:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32800, rc 0) 00000100:00100000:1.0:1789596764.538944:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+15:10302:x1876527944855424:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 615us (1525us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1789596764.538952:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 41 00000100:00100000:0.0:1789596764.542011:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596764.542213:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944855680 00000100:00100000:2.0:1789596764.542224:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944855680 00000100:00100000:2.0:1789596764.542405:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 7 00000100:00100000:2.0:1789596764.542417:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+15:10302:x1876527944855680:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:2.0:1789596764.542677:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:10302:x1876527944855680:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 261us (676us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789596764.542685:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 7 00000100:00100000:2.0:1789596764.615205:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596764.615315:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944855808 00000100:00100000:0.0:1789596764.615324:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944855808 00000100:00100000:0.0:1789596764.615377:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 42 00000100:00100000:0.0:1789596764.615385:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:10308:x1876527944855808:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789596764.615408:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596764.615576:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7cac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344da1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596764.615648:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7cb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596764.615662:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596764.615675:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596764.615710:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789596764.615714:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789596764.615734:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7cb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596764.615769:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7cac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344da1 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596764.615790:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7cb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344da1 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596764.615799:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:0.0:1789596764.615801:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789596764.615805:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030c00, rc 0) 00000100:00100000:0.0:1789596764.615919:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+17:10308:x1876527944855808:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 535us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596764.615925:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 42 00000100:00100000:0.0:1789596764.622965:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596764.623049:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944856064 00000100:00100000:3.0:1789596764.623059:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944856064 00000100:00100000:3.0:1789596764.623121:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 43 00000100:00100000:3.0:1789596764.623132:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+17:10308:x1876527944856064:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:3.0:1789596764.623157:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596764.623181:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d7cba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344da8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.623298:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7cc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.623313:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.623324:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596764.623336:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789596764.623704:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d7cba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344da8 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.623724:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344da8 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.623732:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d1438900) 00010000:00010000:3.0:1789596764.623735:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596764.623738:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89e00, rc 0) 00000100:00100000:3.0:1789596764.623896:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:10308:x1876527944856064:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 766us (940us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789596764.623920:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 43 00000100:00100000:0.0:1789596764.636748:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596764.636801:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596764.637328:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944856448 00000100:00100000:1.0:1789596764.637337:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944856448 00000100:00100000:1.0:1789596764.637403:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2 00000100:00100000:1.0:1789596764.637415:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:2352:x1876527944856448:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596764.637442:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596764.637469:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7cc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344da8 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.637490:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d1438900) 00010000:00010000:1.0:1789596764.637495:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596764.637566:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:2352:x1876527944856448:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 153us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596764.637574:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2 00000100:00100000:2.0:1789596764.638015:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944856320 00000100:00100000:2.0:1789596764.638022:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944856320 00000100:00100000:2.0:1789596764.638062:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 44 00000100:00100000:2.0:1789596764.638070:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:10308:x1876527944856320:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:2.0:1789596764.638090:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596764.638107:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7ccf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344daf expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.638207:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7cd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.638221:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7cd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.638232:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7cd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596764.638244:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789596764.638387:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7ccf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344daf expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.638404:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7cd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344daf expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.638412:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d1438900) 00010000:00010000:2.0:1789596764.638415:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789596764.638417:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426000, rc 0) 00000100:00100000:2.0:1789596764.638636:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:10308:x1876527944856320:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 566us (1900us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789596764.638663:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 44 00000100:00100000:0.0:1789596764.646104:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596764.646204:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944856576 00000100:00100000:1.0:1789596764.646216:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944856576 00000100:00100000:1.0:1789596764.646292:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 23 00000100:00100000:1.0:1789596764.646302:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2353:x1876527944856576:12345-192.168.202.44@tcp:1:lfs.0 00010000:00010000:1.0:1789596764.646348:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d0a2c13/0x8973ae90b38d7ce4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.646392:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c60ba19c/0x8973ae90b38d7c97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d93 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.646401:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596764.646406:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789596764.646411:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d0a2c13/0x8973ae90b38d7ce4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.646450:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c60ba19c/0x8973ae90b38d7c97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d93 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.646466:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c60ba19c/0x8973ae90b38d7c97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d93 expref: 7 pid: 6692 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596764.646493:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa661180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876527964811264:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789596764.647280:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c533a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596764.649550:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596764.649754:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa661180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876527964811264:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596764.649783:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009d0a2c13/0x8973ae90b38d7ce4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596764.649871:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944856704 00000100:00100000:0.0:1789596764.649877:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944856704 00002000:00100000:0.0:1789596764.649919:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9ea8c37a9880 x1876527944856704/t0(0) o4->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:645/0 lens 504/0 e 0 to 0 dl 1789596775 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789596764.649928:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8c37a9880 with x1876527944856704 ext(0->12) 00010000:00010000:0.0:1789596764.649935:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c60ba19c/0x8973ae90b38d7c97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d93 expref: 8 pid: 6692 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596764.649948:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c60ba19c/0x8973ae90b38d7c97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d93 expref: 8 pid: 6692 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789596764.649973:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ea8c37a9880 00000100:00100000:0.0:1789596764.650005:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 0 00000100:00100000:0.0:1789596764.650013:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2354:x1876527944856704:12345-192.168.202.44@tcp:4:lfs.0 00000001:00100000:2.0:1789596764.690943:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1fdd0e7b-fe25-4537-b350-ae6aecfab059 00000100:00100000:0.0:1789596764.692080:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:2354:x1876527944856704:12345-192.168.202.44@tcp:4:lfs.0 Request processed in 42057us (42529us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789596764.692093:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 0 00002000:00100000:0.0:1789596764.692105:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9ea8c37a9880 x1876527944856704/t4294967299(0) o4->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:645/0 lens 504/448 e 0 to 0 dl 1789596775 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789596764.692117:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8c37a9880 with x1876527944856704 ext(0->12) 00010000:00010000:0.0:1789596764.692128:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c60ba19c/0x8973ae90b38d7c97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d93 expref: 9 pid: 6692 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596764.692149:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c60ba19c/0x8973ae90b38d7c97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d93 expref: 9 pid: 6692 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789596764.692156:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ea8c37a9880 00000100:00100000:0.0:1789596764.695800:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596764.696139:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944856832 00000100:00100000:3.0:1789596764.696151:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944856832 00010000:00010000:3.0:1789596764.696194:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c60ba19c/0x8973ae90b38d7c97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d93 expref: 9 pid: 6692 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596764.696241:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 36 00000100:00100000:3.0:1789596764.696251:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7496300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:2353:x1876527944856832:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596764.696269:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789596764.696293:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789596764.696296:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789596764 00002000:00010000:3.0:1789596764.696298:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789596764 00002000:00010000:3.0:1789596764.696301:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789596764 00010000:00010000:3.0:1789596764.696308:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c60ba19c/0x8973ae90b38d7c97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d93 expref: 9 pid: 6692 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.696323:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c60ba19c/0x8973ae90b38d7c97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d93 expref: 9 pid: 6692 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.696355:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c60ba19c/0x8973ae90b38d7c97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d93 expref: 9 pid: 6692 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.696373:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789596764.696378:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789596764.696385:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009d0a2c13/0x8973ae90b38d7ce4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.696414:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d0a2c13/0x8973ae90b38d7ce4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.696457:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596764.696717:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009d0a2c13/0x8973ae90b38d7ce4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.696729:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d0a2c13/0x8973ae90b38d7ce4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.696756:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d0a2c13/0x8973ae90b38d7ce4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.696765:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d0a2c13/0x8973ae90b38d7ce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.696774:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d0a2c13/0x8973ae90b38d7ce4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.696782:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596764.696788:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d0a2c13/0x8973ae90b38d7ce4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.696798:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d0a2c13/0x8973ae90b38d7ce4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.696810:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d0a2c13/0x8973ae90b38d7ce4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.696847:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d0a2c13/0x8973ae90b38d7ce4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596764.696980:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7496300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2353:x1876527944856832:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 728us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596764.696989:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 36 00000100:00100000:2.0:1789596764.697145:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2353:x1876527944856576:12345-192.168.202.44@tcp:1:lfs.0 Request processed in 50844us (51053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596764.697153:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 23 00000100:00100000:3.0:1789596764.700332:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596764.700423:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944857088 00000100:00100000:1.0:1789596764.700433:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944857088 00000100:00100000:1.0:1789596764.700517:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 8 00000100:00100000:1.0:1789596764.700528:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:10308:x1876527944857088:12345-192.168.202.44@tcp:35:lfs.0 00000004:00010000:1.0:1789596764.700616:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7cd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344daf expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789596764.700928:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1789596764.700986:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1789596764.701515:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1789596764.701580:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d7ceb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.701596:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7c7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d85 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.701606:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d7ceb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.701641:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7c7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d85 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.701657:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7c7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d85 expref: 24 pid: 5842 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596764.701672:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa661180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1876527964811392:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789596764.701760:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c51b7900 going to sleep for 11 seconds 00000100:00100000:3.0:1789596764.705065:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596764.705168:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944857216 00000100:00100000:0.0:1789596764.705178:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944857216 00010000:00010000:0.0:1789596764.705221:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7c7b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d85 expref: 25 pid: 5842 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596764.705279:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 37 00000100:00100000:0.0:1789596764.705288:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+25:2354:x1876527944857216:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596764.705317:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596764.705325:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7c7b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d85 expref: 25 pid: 5842 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596764.705338:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7c7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d85 expref: 25 pid: 5842 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596764.705361:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d1438900) 00010000:00010000:0.0:1789596764.705366:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d7ceb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596764.705376:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d7ceb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596764.705383:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d7ceb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596764.705401:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596764.705471:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+25:2354:x1876527944857216:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 174us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596764.705478:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 37 00010000:00010000:1.0:1789596764.705722:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7c7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d85 expref: 24 pid: 5842 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596764.705741:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa661180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1876527964811392:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596764.705762:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d7ceb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.705779:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d7ceb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.705785:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d7ceb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789596764.705946:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1789596764.706165:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1789596764.706304:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa661180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1876527964811520:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789596764.706392:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596764.706422:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c51b70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596764.706453:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964811520 00000100:00100000:1.0:1789596764.706458:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964811520 00000100:00100000:1.0:1789596764.706520:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789596764.706528:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1876527964811520:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789596764.706598:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1876527964811520:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 70us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596764.706605:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789596764.706643:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa661180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1876527964811520:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789596764.707296:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1789596764.707361:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa661180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1876527964811648:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789596764.707400:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596764.707434:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964811648 00000100:00100000:1.0:1789596764.707439:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964811648 00000100:00100000:1.0:1789596764.707466:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789596764.707473:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1876527964811648:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789596764.707639:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1876527964811648:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 165us (237us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789596764.707646:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789596764.707669:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c51b7900 going to sleep for 11 seconds 00000100:00100000:1.0:1789596764.707692:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa661180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1876527964811648:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789596764.707733:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1789596764.707767:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d7ceb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.707776:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d7ceb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.707784:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d7ceb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.707790:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596764.707795:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d7ceb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.707803:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d7ceb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.707849:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d1438900) 00010000:00010000:1.0:1789596764.707853:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789596764.707857:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d7ceb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596764.707864:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d7ceb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789596764.708027:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789596764.708250:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789596764.708262:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 349672444435ns, next at 350672442039ns, rc = 0 00000001:00080000:1.0:1789596764.708269:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1789596764.708303:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d1438900) 00010000:00010000:1.0:1789596764.708307:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789596764.708314:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d7cd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344daf expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596764.708395:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:10308:x1876527944857088:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 7869us (8072us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789596764.708403:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 8 00000020:00080000:1.0:1789596764.708407:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1789596764.708798:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789596764.710994:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596764.711105:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944857344 00000100:00100000:2.0:1789596764.711116:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944857344 00000100:00100000:2.0:1789596764.711172:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 45 00000100:00100000:2.0:1789596764.711183:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:10308:x1876527944857344:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:2.0:1789596764.711209:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596764.711233:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7cf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344db6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.711306:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7cf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344db6 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.711321:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7cf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344db6 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.711340:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:2.0:1789596764.711344:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596764.711348:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426800, rc 0) 00000100:00100000:2.0:1789596764.711400:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+28:10308:x1876527944857344:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 219us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596764.711424:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 45 00000100:00100000:3.0:1789596764.714711:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596764.714867:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944857600 00000100:00100000:2.0:1789596764.714878:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944857600 00000100:00100000:2.0:1789596764.714941:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 9 00000100:00100000:2.0:1789596764.714952:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3553c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+28:10308:x1876527944857600:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:2.0:1789596764.715199:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3553c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+29:10308:x1876527944857600:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 247us (495us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1789596764.715206:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 9 00000100:00100000:0.0:1789596764.782966:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596764.783040:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944857856 00000100:00100000:2.0:1789596764.783052:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944857856 00000100:00100000:2.0:1789596764.783115:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 46 00000100:00100000:2.0:1789596764.783127:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+29:10318:x1876527944857856:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:2.0:1789596764.783152:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596764.783174:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7cf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344dbd expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596764.783264:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789596764.783386:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7cf9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dbd expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.783401:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea800) 00010000:00010000:2.0:1789596764.783405:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789596764.783410:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7cf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dbd expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.783426:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427e00, rc 0) 00000100:00100000:2.0:1789596764.783534:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+30:10318:x1876527944857856:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 410us (591us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1789596764.783542:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 46 00000100:00100000:3.0:1789596764.785758:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596764.785808:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944857984 00000100:00100000:2.0:1789596764.785847:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944857984 00000100:00100000:2.0:1789596764.785948:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 47 00000100:00100000:2.0:1789596764.785959:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+30:10318:x1876527944857984:12345-192.168.202.44@tcp:34:lfs.0 00010000:00010000:2.0:1789596764.786040:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786057:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786070:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786086:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786093:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786100:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786186:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7d15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786195:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786202:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596764.786251:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786265:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786272:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786280:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786286:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427a00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596764.786291:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786299:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786311:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:2.0:1789596764.786314:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596764.786319:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786326:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786341:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786348:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786359:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786365:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596764.786369:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786375:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786383:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ea8e0eea600) 00010000:00010000:2.0:1789596764.786386:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596764.786389:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786395:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786409:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786416:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7d15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786421:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7d15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786427:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596764.786430:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7d15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786446:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7d15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786454:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:2.0:1789596764.786456:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596764.786471:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7d15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.786477:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7d15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596764.786559:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+30:10318:x1876527944857984:12345-192.168.202.44@tcp:34:lfs.0 Request processed in 601us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596764.786568:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 47 00000100:00100000:3.0:1789596764.788220:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596764.788294:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944858240 00000100:00100000:2.0:1789596764.788304:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944858240 00000100:00100000:2.0:1789596764.788410:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 10 00000100:00100000:2.0:1789596764.788421:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+30:10318:x1876527944858240:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:2.0:1789596764.788691:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+31:10318:x1876527944858240:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 272us (479us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789596764.788699:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 10 00000100:00100000:3.0:1789596764.814342:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596764.814416:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944858496 00000100:00100000:2.0:1789596764.814427:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944858496 00000100:00100000:2.0:1789596764.814495:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 48 00000100:00100000:2.0:1789596764.814515:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+31:10321:x1876527944858496:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:2.0:1789596764.814540:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596764.814560:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7d1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344dc4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.814653:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.814668:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.814680:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.814694:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.814701:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.814707:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.814854:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.814862:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.814869:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596764.814880:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789596764.814974:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.814982:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.814994:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.815000:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596764.815004:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.815011:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.815022:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:2.0:1789596764.815025:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596764.815029:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.815036:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.815053:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.815060:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.815064:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.815069:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427a00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596764.815072:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.815086:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.815094:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ea8e0eea600) 00010000:00010000:2.0:1789596764.815096:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596764.815099:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.815104:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.815328:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7d1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dc4 expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.815344:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dc4 expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596764.815351:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:3.0:1789596764.815353:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596764.815356:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427e00, rc 0) 00000100:00100000:3.0:1789596764.815417:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+33:10321:x1876527944858496:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 904us (1085us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789596764.815425:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 48 00000100:00100000:3.0:1789596764.818673:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596764.818756:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944858624 00000100:00100000:2.0:1789596764.818767:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944858624 00000100:00100000:2.0:1789596764.818916:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 49 00000100:00100000:2.0:1789596764.818928:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+33:10321:x1876527944858624:12345-192.168.202.44@tcp:54:lfs.0 00010000:00010000:2.0:1789596764.818997:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.819013:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.819024:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.819047:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.819053:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.819076:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.819081:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596764.819086:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.819092:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.819104:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:2.0:1789596764.819107:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789596764.819111:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596764.819116:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596764.819187:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+33:10321:x1876527944858624:12345-192.168.202.44@tcp:54:lfs.0 Request processed in 263us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596764.819194:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 49 00000100:00100000:2.0:1789596764.821239:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596764.821321:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944858880 00000100:00100000:1.0:1789596764.821331:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944858880 00000100:00100000:1.0:1789596764.821394:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 11 00000100:00100000:1.0:1789596764.821403:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+33:10321:x1876527944858880:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:1.0:1789596764.821684:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+34:10321:x1876527944858880:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 282us (452us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1789596764.821692:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 11 00000100:00100000:3.0:1789596765.023089:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596765.023210:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944859136 00000100:00100000:1.0:1789596765.023221:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944859136 00000100:00100000:1.0:1789596765.023290:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 50 00000100:00100000:1.0:1789596765.023301:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c570a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+34:10352:x1876527944859136:12345-192.168.202.44@tcp:101:cat.0 00010000:00010000:1.0:1789596765.023327:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596765.023349:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d7d46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344dcb expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.023475:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d7d4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.023490:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d7d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.023529:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d7d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596765.023540:0:10902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789596765.023688:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d7d46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dcb expref: 37 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.023709:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d7d4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dcb expref: 36 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.023718:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:1.0:1789596765.023721:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789596765.023725:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a33a00, rc 0) 00000100:00100000:1.0:1789596765.023778:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c570a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+36:10352:x1876527944859136:12345-192.168.202.44@tcp:101:cat.0 Request processed in 480us (699us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789596765.023786:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 50 00000100:00100000:3.0:1789596765.029346:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596765.029439:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944859392 00000100:00100000:1.0:1789596765.029449:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944859392 00000100:00100000:1.0:1789596765.029534:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 12 00000100:00100000:1.0:1789596765.029544:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+36:10352:x1876527944859392:12345-192.168.202.44@tcp:35:cat.0 00000100:00100000:1.0:1789596765.029797:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+37:10352:x1876527944859392:12345-192.168.202.44@tcp:35:cat.0 Request processed in 254us (461us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789596765.029840:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 12 00000100:00100000:2.0:1789596765.031038:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596765.031123:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944859520 00000100:00100000:0.0:1789596765.031130:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944859520 00000100:00100000:0.0:1789596765.031182:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 3 00000100:00100000:0.0:1789596765.031191:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c8283050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+37:2354:x1876527944859520:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596765.031206:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596765.031249:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d7d4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dcb expref: 37 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.031268:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:0.0:1789596765.031274:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596765.031321:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c8283050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+36:2354:x1876527944859520:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 131us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596765.031329:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 3 00010000:00010000:0.0:1789596765.083169:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596765.086972:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596765.087121:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944859776 00000100:00100000:1.0:1789596765.087132:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944859776 00000100:00100000:1.0:1789596765.087194:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 51 00000100:00100000:1.0:1789596765.087205:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+36:10358:x1876527944859776:12345-192.168.202.44@tcp:101:dd.0 00010000:00010000:1.0:1789596765.087242:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596765.087246:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789596765.087271:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7cb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344da1 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.087293:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:1.0:1789596765.087298:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789596765.087310:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d7d5b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344dd2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.087400:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d7d62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.087414:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dc4 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.087423:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d7d62 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.087456:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dc4 expref: 36 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.087480:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dc4 expref: 36 pid: 5841 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596765.087519:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa660700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964811776:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789596765.087856:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c51b7900 going to sleep for 11 seconds 00000100:00100000:2.0:1789596765.091422:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa660700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964811776:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789596765.091455:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d7d62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596765.092298:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596765.092373:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944859904 00000100:00100000:0.0:1789596765.092381:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944859904 00010000:00010000:0.0:1789596765.092420:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dc4 expref: 37 pid: 5841 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596765.092459:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 38 00000100:00100000:0.0:1789596765.092468:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5709500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+37:2353:x1876527944859904:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596765.092483:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596765.092489:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dc4 expref: 37 pid: 5841 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.092510:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dc4 expref: 37 pid: 5841 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.092531:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dc4 expref: 37 pid: 5841 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.092545:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:0.0:1789596765.092550:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d7d62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.092571:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d7d62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.092578:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d7d62 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.092621:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596765.092671:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5709500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+36:2353:x1876527944859904:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 203us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596765.092679:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 38 00010000:00010000:1.0:1789596765.092794:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d7d62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.092801:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d7d62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596765.092857:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789596765.093029:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d7d5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dd2 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.093044:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d7d62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dd2 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.093052:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:1.0:1789596765.093054:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789596765.093057:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32a00, rc 0) 00000100:00100000:1.0:1789596765.093082:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5709c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+36:10358:x1876527944859776:12345-192.168.202.44@tcp:101:dd.0 Request processed in 5880us (6122us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789596765.093088:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 51 00000100:00100000:1.0:1789596765.096238:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596765.096337:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944860160 00000100:00100000:2.0:1789596765.096349:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944860160 00000100:00100000:2.0:1789596765.096426:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 52 00000100:00100000:2.0:1789596765.096436:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+36:10358:x1876527944860160:12345-192.168.202.44@tcp:36:dd.0 00010000:00010000:2.0:1789596765.096725:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596765.096743:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596765.096755:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789596765.096809:0:10902:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1789596765.096913:0:10902:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bdc598de reply state 000000004a815257 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596765.096922:0:10902:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789596765.097100:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+39:10358:x1876527944860160:12345-192.168.202.44@tcp:36:dd.0 Request processed in 665us (882us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789596765.097107:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 52 00000020:00080000:2.0:1789596765.097112:0:10902:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789596765.107859:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.107881:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.107912:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.107918:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427a00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596765.107923:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.107931:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.107950:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:1.0:1789596765.107953:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596765.107958:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.107963:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596765.391405:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596765.391849:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944860288 00000100:00100000:2.0:1789596765.391860:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944860288 00000100:00100000:2.0:1789596765.391920:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 53 00000100:00100000:2.0:1789596765.391930:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+38:10372:x1876527944860288:12345-192.168.202.44@tcp:101:stat.0 00010000:00010000:2.0:1789596765.391955:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596765.391987:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344dd9 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596765.392074:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596765.392099:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596765.392111:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596765.392127:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596765.392135:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596765.392142:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596765.392241:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596765.392252:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d7d62 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dd2 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596765.392261:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d8c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596765.392301:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d7d62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dd2 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596765.392315:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d7d62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dd2 expref: 39 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596765.392341:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1876527964811904:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789596765.393203:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d3548a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789596765.396691:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596765.397003:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944860544 00000100:00100000:1.0:1789596765.397015:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944860544 00000100:00100000:1.0:1789596765.397092:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 13 00000100:00100000:1.0:1789596765.397102:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+40:5589:x1876527944860544:12345-192.168.202.44@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789596765.397450:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+41:5589:x1876527944860544:12345-192.168.202.44@tcp:35:ldlm_bl.0 Request processed in 349us (769us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1789596765.397467:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 13 00000100:00100000:2.0:1789596765.398348:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1876527964811904:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789596765.398380:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596765.400701:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596765.400810:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944860672 00000100:00100000:2.0:1789596765.400850:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944860672 00010000:00010000:2.0:1789596765.400899:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d7d62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dd2 expref: 41 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596765.400942:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 39 00000100:00100000:2.0:1789596765.400952:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+41:2353:x1876527944860672:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596765.400968:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596765.400975:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d7d62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dd2 expref: 41 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596765.400988:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d7d62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dd2 expref: 41 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596765.401008:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d7d62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dd2 expref: 41 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596765.401024:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:2.0:1789596765.401029:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596765.401053:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596765.401061:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d8c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596765.401094:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596765.401156:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+40:2353:x1876527944860672:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 205us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596765.401162:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 39 00010000:00010000:0.0:1789596765.401424:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.401433:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596765.401488:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789596765.401501:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789596765.401547:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.401560:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.401571:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.401577:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d7e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.401606:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.401612:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427a00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596765.401616:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.401624:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d7e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.401632:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:0.0:1789596765.401635:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596765.401639:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.401644:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7d7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.401656:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.401661:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.401666:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.401671:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596765.401673:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.401687:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.401695:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ea8e0eea600) 00010000:00010000:0.0:1789596765.401697:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596765.401700:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.401707:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7d85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.401744:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7d77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dd9 expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.401757:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dd9 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.401764:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:0.0:1789596765.401766:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596765.401768:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426c00, rc 0) 00000100:00100000:0.0:1789596765.401797:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+39:10372:x1876527944860288:12345-192.168.202.44@tcp:101:stat.0 Request processed in 9869us (10404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596765.401805:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 53 00000100:00100000:3.0:1789596765.480396:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596765.480633:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944860928 00000100:00100000:0.0:1789596765.480644:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944860928 00000100:00100000:0.0:1789596765.480710:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 54 00000100:00100000:0.0:1789596765.480721:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+39:10378:x1876527944860928:12345-192.168.202.44@tcp:36:truncate.0 00010000:00010000:0.0:1789596765.480797:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596765.480854:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7d8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dd9 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.480874:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:0.0:1789596765.480880:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596765.481104:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7d93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.481117:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7d93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.481126:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7d93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789596765.481176:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1789596765.481198:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f92d41aa reply state 000000008dfd6d27 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7d93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596765.481206:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789596765.481334:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef646680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+41:10378:x1876527944860928:12345-192.168.202.44@tcp:36:truncate.0 Request processed in 614us (947us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789596765.481341:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 54 00000020:00080000:0.0:1789596765.481346:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789596765.485093:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7d93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.485110:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7d93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.485118:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7d93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.485137:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596765.485142:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7d93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.485149:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7d93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.485165:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:0.0:1789596765.485177:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596765.485181:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7d93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.485187:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7d93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596765.642477:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596765.643115:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944861056 00000100:00100000:1.0:1789596765.643127:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944861056 00000100:00100000:1.0:1789596765.643199:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 55 00000100:00100000:1.0:1789596765.643209:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+40:10392:x1876527944861056:12345-192.168.202.44@tcp:101:stat.0 00010000:00010000:1.0:1789596765.643240:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596765.643261:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d7d9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344de0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643321:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32000/0x8973ae90b38d7da1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643334:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32000/0x8973ae90b38d7da1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643344:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32000/0x8973ae90b38d7da1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643357:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d7da8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643363:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d7da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643368:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d7da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643448:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d7daf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643466:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d7daf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643473:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d7daf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596765.643529:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1789596765.643533:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789596765.643555:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d7daf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643565:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d7daf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643573:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32000/0x8973ae90b38d7da1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643578:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32000/0x8973ae90b38d7da1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643584:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32000/0x8973ae90b38d7da1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643603:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596765.643608:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32000/0x8973ae90b38d7da1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643615:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32000/0x8973ae90b38d7da1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643626:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:1.0:1789596765.643629:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596765.643633:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32000/0x8973ae90b38d7da1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643638:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32000/0x8973ae90b38d7da1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643663:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d7da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643669:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d7da8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643675:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d7da8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643680:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a33000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596765.643683:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d7da8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643688:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d7da8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643695:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ea8c36d5000) 00010000:00010000:1.0:1789596765.643697:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596765.643700:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d7da8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643705:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d7da8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643736:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d7d9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344de0 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643748:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d7daf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344de0 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.643764:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:1.0:1789596765.643766:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789596765.643768:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32600, rc 0) 00000100:00100000:1.0:1789596765.644232:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+41:10392:x1876527944861056:12345-192.168.202.44@tcp:101:stat.0 Request processed in 1011us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596765.644242:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 55 00000100:00100000:1.0:1789596765.711639:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596765.711721:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944861312 00000100:00100000:0.0:1789596765.711730:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944861312 00000100:00100000:0.0:1789596765.711780:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 56 00000100:00100000:0.0:1789596765.711787:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+41:10402:x1876527944861312:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789596765.711804:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596765.711847:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7db6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344de7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596765.711930:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789596765.712041:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7db6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344de7 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.712052:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea800) 00010000:00010000:0.0:1789596765.712058:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789596765.712063:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7db6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344de7 expref: 43 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.712076:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030c00, rc 0) 00000100:00100000:0.0:1789596765.712124:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+42:10402:x1876527944861312:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 338us (499us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1789596765.712129:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 56 00000100:00100000:3.0:1789596765.714455:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596765.714660:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944861568 00000100:00100000:1.0:1789596765.714669:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944861568 00000100:00100000:1.0:1789596765.714742:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 14 00000100:00100000:1.0:1789596765.714749:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+42:10402:x1876527944861568:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:1.0:1789596765.714979:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+43:10402:x1876527944861568:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 230us (533us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789596765.714987:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 14 00000100:00100000:1.0:1789596765.799162:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596765.799250:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944861824 00000100:00100000:3.0:1789596765.799262:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944861824 00000100:00100000:3.0:1789596765.799327:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 57 00000100:00100000:3.0:1789596765.799338:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+43:10408:x1876527944861824:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:3.0:1789596765.799364:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596765.799387:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d7dc4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344dee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.799505:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7dcb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.799522:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d7daf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344de0 expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.799531:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7dcb lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.799564:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d7daf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344de0 expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.799590:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d7daf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344de0 expref: 44 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596765.799604:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef645c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1876527964812032:192.168.202.44@tcp:104: 00000100:00100000:3.0:1789596765.799691:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff4b0780 going to sleep for 11 seconds 00000100:00100000:1.0:1789596765.815729:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596765.815853:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944861952 00000100:00100000:0.0:1789596765.815863:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944861952 00010000:00010000:0.0:1789596765.815901:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d7daf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344de0 expref: 45 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596765.815938:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 40 00000100:00100000:0.0:1789596765.815947:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+45:2353:x1876527944861952:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596765.815963:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596765.815970:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d7daf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344de0 expref: 45 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.815984:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d7daf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344de0 expref: 45 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.816004:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:0.0:1789596765.816010:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7dcb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.816020:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7dcb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.816046:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7dcb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.816064:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596765.816120:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef649180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+45:2353:x1876527944861952:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 172us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596765.816127:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 40 00010000:00010000:3.0:1789596765.816678:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d7daf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344de0 expref: 44 pid: 5843 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596765.816697:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef645c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1876527964812032:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789596765.816716:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7dcb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.816726:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7dcb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.816733:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7dcb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596765.816751:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1789596765.817064:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d7dc4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dee expref: 45 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.817082:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7dcb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dee expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.817091:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:3.0:1789596765.817103:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789596765.817107:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88600, rc 0) 00000100:00100000:3.0:1789596765.817145:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+44:10408:x1876527944861824:12345-192.168.202.44@tcp:101:bash.0 Request processed in 17809us (17992us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1789596765.817152:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 57 00000100:00100000:1.0:1789596765.820937:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596765.821003:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944862208 00000100:00100000:3.0:1789596765.821014:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944862208 00000100:00100000:3.0:1789596765.821075:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 58 00000100:00100000:3.0:1789596765.821085:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+44:10408:x1876527944862208:12345-192.168.202.44@tcp:36:bash.0 00010000:00010000:3.0:1789596765.821372:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7dd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.821391:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7dd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.821403:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7dd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789596765.821459:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1789596765.821483:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d740782 reply state 0000000028a08c0e transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7dd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596765.821503:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789596765.821593:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+47:10408:x1876527944862208:12345-192.168.202.44@tcp:36:bash.0 Request processed in 510us (664us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789596765.821600:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 58 00000020:00080000:3.0:1789596765.821604:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789596765.825845:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7dd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.825863:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7dd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.825871:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7dd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.825876:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596765.825896:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7dd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.825904:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7dd9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.825921:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:1.0:1789596765.825924:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596765.825928:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7dd9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.825935:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7dd9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596765.826560:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596765.827797:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944862336 00000100:00100000:1.0:1789596765.827811:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944862336 00000100:00100000:1.0:1789596765.828042:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 59 00000100:00100000:1.0:1789596765.828053:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+46:10408:x1876527944862336:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:1.0:1789596765.828075:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596765.828094:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32000/0x8973ae90b38d7de0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344df5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.828197:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d7de7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.828212:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7dcb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dee expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.828230:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d7de7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.828281:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7dcb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dee expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.828295:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7dcb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dee expref: 47 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596765.828310:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef649880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964812160:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789596765.828443:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c80cea80 going to sleep for 11 seconds 00000001:00080000:1.0:1789596765.828463:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967339 is committed 00000001:00080000:1.0:1789596765.828482:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967340 is committed 00000004:00080000:1.0:1789596765.828506:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1789596765.828530:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ea8c51b70c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1789596765.828534:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ea8f68d6400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ea8c51b7180 00000020:00080000:1.0:1789596765.828537:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ea8f68d6100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ea900650800 00000100:00100000:1.0:1789596765.829200:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f7496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964812288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789596765.829258:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596765.829390:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964812288 00000100:00100000:0.0:1789596765.829397:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964812288 00000100:00100000:0.0:1789596765.829440:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789596765.829448:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1876527964812288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789596765.829469:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1789596765.829508:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aab145c, atime: 0x6aab145c, ctime: 0x6aab145c, blocks: 0x1 00010000:00010000:0.0:1789596765.829516:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d7dee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.829529:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=350s v=(0 0) 00010000:00010000:0.0:1789596765.829534:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596765.829540:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d7dee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.829556:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d7dee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.829567:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d7dee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.829600:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d7dee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.829615:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789596765.830120:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1876527964812288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 671us (859us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789596765.830128:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789596765.830440:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789596765.830448:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d7dee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.830457:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030e00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:1.0:1789596765.830462:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d7dee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.830472:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d7dee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.830506:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d7dee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.830515:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d7dee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.830538:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596765.830540:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596765.830542:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789596765.830579:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ea8f7496300/2, rc 0, transno 4294967301 00000100:00100000:1.0:1789596765.830586:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f7496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964812288:0@lo:6:osp-syn-1-0.0 00000020:00080000:2.0:1789596765.830918:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789596765.830996:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789596765.834894:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596765.835005:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944862464 00000100:00100000:0.0:1789596765.835014:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944862464 00010000:00010000:0.0:1789596765.835056:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7dcb lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dee expref: 16 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596765.835093:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 41 00000100:00100000:0.0:1789596765.835103:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900009500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:2354:x1876527944862464:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596765.835117:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596765.835124:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7dcb lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dee expref: 16 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.835137:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7dcb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dee expref: 16 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.835158:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:0.0:1789596765.835164:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d7de7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.835174:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d7de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.835197:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d7de7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596765.835217:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596765.835281:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900009500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:2354:x1876527944862464:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 179us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596765.835288:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 41 00010000:00010000:1.0:1789596765.835394:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7dcb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dee expref: 15 pid: 5842 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596765.835411:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef649880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964812160:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596765.835432:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d7de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.835441:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d7de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.835448:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d7de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596765.835507:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789596765.835511:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789596765.835531:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d7de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.835570:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32000/0x8973ae90b38d7de0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344df5 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.835585:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d7de7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344df5 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596765.835699:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:1.0:1789596765.835702:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789596765.835705:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a33200, rc 0) 00000100:00100000:1.0:1789596765.835731:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef645c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:10408:x1876527944862336:12345-192.168.202.44@tcp:101:bash.0 Request processed in 7681us (9177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596765.835738:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 59 00000100:00100000:0.0:1789596765.839048:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596765.839144:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944862720 00000100:00100000:2.0:1789596765.839155:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944862720 00000100:00100000:2.0:1789596765.839604:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 15 00000100:00100000:2.0:1789596765.839617:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3550050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:10408:x1876527944862720:12345-192.168.202.44@tcp:35:bash.0 00000100:00100000:2.0:1789596765.839872:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3550050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+15:10408:x1876527944862720:12345-192.168.202.44@tcp:35:bash.0 Request processed in 258us (831us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789596765.839880:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 15 00000100:00100000:0.0:1789596765.963992:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596765.964088:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944862976 00000100:00100000:3.0:1789596765.964099:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944862976 00000100:00100000:3.0:1789596765.964179:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 60 00000100:00100000:3.0:1789596765.964189:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+15:10418:x1876527944862976:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:3.0:1789596765.964215:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596765.964252:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d7df5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344dfc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596765.964343:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789596765.964462:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d7df5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dfc expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.964476:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea800) 00010000:00010000:3.0:1789596765.964479:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789596765.964485:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d7df5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344dfc expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.964511:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89200, rc 0) 00000100:00100000:3.0:1789596765.964570:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:10418:x1876527944862976:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 382us (588us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1789596765.964577:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 60 00000100:00100000:0.0:1789596765.968601:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596765.968670:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944863104 00000100:00100000:3.0:1789596765.968680:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944863104 00000100:00100000:3.0:1789596765.968739:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 61 00000100:00100000:3.0:1789596765.968750:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:10418:x1876527944863104:12345-192.168.202.44@tcp:34:lfs.0 00010000:00010000:3.0:1789596765.968856:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e03 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.968874:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.968903:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.968918:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.968924:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.968929:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969201:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969212:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969220:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789596765.969274:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969286:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969293:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969300:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969316:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596765.969320:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969327:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969339:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:3.0:1789596765.969342:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596765.969346:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969353:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969367:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969372:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969378:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969384:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596765.969387:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969392:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969409:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ea8d1438400) 00010000:00010000:3.0:1789596765.969412:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596765.969415:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969421:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969438:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969444:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969449:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969454:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596765.969457:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969463:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969471:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:3.0:1789596765.969474:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596765.969476:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596765.969482:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596765.969574:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:10418:x1876527944863104:12345-192.168.202.44@tcp:34:lfs.0 Request processed in 826us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596765.969581:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 61 00000100:00100000:0.0:1789596765.972874:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596765.973000:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944863360 00000100:00100000:1.0:1789596765.973010:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944863360 00000100:00100000:1.0:1789596765.973070:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 16 00000100:00100000:1.0:1789596765.973080:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:10418:x1876527944863360:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:1.0:1789596765.973302:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+17:10418:x1876527944863360:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 223us (437us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1789596765.973310:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 16 00000100:00100000:0.0:1789596766.051425:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596766.051704:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944863616 00000100:00100000:3.0:1789596766.051714:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944863616 00000100:00100000:3.0:1789596766.051783:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 62 00000100:00100000:3.0:1789596766.051794:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+17:10421:x1876527944863616:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:3.0:1789596766.051838:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596766.051860:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e03 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.051932:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e1f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.051948:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.051961:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.051976:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.051983:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.051989:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.052307:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d7e2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.052317:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d7e2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.052324:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d7e2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596766.052333:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789596766.052422:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.052429:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.052436:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.052441:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596766.052445:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.052572:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.052585:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:3.0:1789596766.052587:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596766.052604:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.052620:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.052634:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.052644:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.052650:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.052655:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596766.052658:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.052663:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.052671:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ea8d1438400) 00010000:00010000:3.0:1789596766.052673:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596766.052676:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.052681:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.052734:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e03 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.052749:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d7e2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e03 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.052762:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:3.0:1789596766.052764:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596766.052767:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89200, rc 0) 00000100:00100000:3.0:1789596766.052880:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:10421:x1876527944863616:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 1088us (1464us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789596766.052888:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 62 00000100:00080000:0.0:1789596766.053558:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596766.060455:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596766.060599:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944863744 00000100:00100000:3.0:1789596766.060609:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944863744 00000100:00100000:3.0:1789596766.060669:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 63 00000100:00100000:3.0:1789596766.060679:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:10421:x1876527944863744:12345-192.168.202.44@tcp:54:lfs.0 00010000:00010000:3.0:1789596766.060745:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.060763:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.060774:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.060799:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.060806:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.060813:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.060846:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596766.060865:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.060874:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.060887:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:3.0:1789596766.060890:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789596766.060895:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.060903:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596766.060978:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:10421:x1876527944863744:12345-192.168.202.44@tcp:54:lfs.0 Request processed in 300us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596766.060985:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 63 00000100:00100000:1.0:1789596766.063418:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596766.063576:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944864000 00000100:00100000:2.0:1789596766.063586:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944864000 00000100:00100000:2.0:1789596766.063664:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 17 00000100:00100000:2.0:1789596766.063674:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:10421:x1876527944864000:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:2.0:1789596766.063947:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:10421:x1876527944864000:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 273us (537us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789596766.063971:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 17 00000100:00100000:0.0:1789596766.068783:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596766.068918:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944864128 00000100:00100000:1.0:1789596766.068930:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944864128 00000100:00100000:1.0:1789596766.068996:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 4 00000100:00100000:1.0:1789596766.069005:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff567b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:2352:x1876527944864128:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596766.069020:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596766.069057:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d7e2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e03 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.069076:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:1.0:1789596766.069080:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596766.069136:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff567b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:2352:x1876527944864128:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 132us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596766.069143:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 4 00010000:00010000:2.0:1789596766.106991:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596766.214209:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596766.215046:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944864384 00000100:00100000:0.0:1789596766.215059:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944864384 00000100:00100000:0.0:1789596766.215127:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 64 00000100:00100000:0.0:1789596766.215137:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:10439:x1876527944864384:12345-192.168.202.44@tcp:101:cat.0 00010000:00010000:0.0:1789596766.215162:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596766.215182:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7e42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e0a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.215286:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7e49 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.215307:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7e49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.215340:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7e49 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596766.215353:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789596766.215503:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7e42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e0a expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.215525:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7e49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e0a expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.215534:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:0.0:1789596766.215537:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789596766.215540:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030e00, rc 0) 00000100:00100000:0.0:1789596766.215617:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef645500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:10439:x1876527944864384:12345-192.168.202.44@tcp:101:cat.0 Request processed in 481us (1418us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789596766.215625:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 64 00000100:00100000:2.0:1789596766.235111:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596766.235132:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964812416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596766.235198:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596766.235458:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964812416 00000100:00100000:3.0:1789596766.235466:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964812416 00000100:00100000:3.0:1789596766.235536:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789596766.235545:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964812416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596766.235576:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596766.235632:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964812416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596766.235638:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1789596766.235767:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596766.235865:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef644000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964812416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596766.257046:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596766.257121:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944864512 00000100:00100000:3.0:1789596766.257132:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944864512 00000100:00100000:3.0:1789596766.257193:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 65 00000100:00100000:3.0:1789596766.257202:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:10440:x1876527944864512:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:3.0:1789596766.257237:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596766.257256:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e11 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.257320:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.257333:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.257345:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596766.257381:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789596766.257385:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789596766.257402:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.257429:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e11 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.257448:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e11 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.257467:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:3.0:1789596766.257470:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789596766.257473:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88600, rc 0) 00000100:00100000:3.0:1789596766.257542:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:10440:x1876527944864512:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 341us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596766.257548:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 65 00000100:00100000:3.0:1789596766.262650:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596766.262778:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944864896 00000100:00100000:2.0:1789596766.262787:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944864896 00000100:00100000:2.0:1789596766.262880:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 18 00000100:00100000:2.0:1789596766.262891:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:10440:x1876527944864896:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:2.0:1789596766.263214:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:10440:x1876527944864896:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 324us (573us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789596766.263221:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 18 00000100:00100000:0.0:1789596766.265907:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596766.266008:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944865024 00000100:00100000:2.0:1789596766.266018:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944865024 00000100:00100000:2.0:1789596766.266078:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 5 00000100:00100000:2.0:1789596766.266088:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef765f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:10440:x1876527944865024:12345-192.168.202.44@tcp:103:lfs.0 00010000:00010000:2.0:1789596766.266102:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789596766.266125:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d7de7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344df5 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.266146:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7e49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e0a expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.266160:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7cf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344db6 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.266178:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:2.0:1789596766.266189:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596766.266373:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef765f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:10440:x1876527944865024:12345-192.168.202.44@tcp:103:lfs.0 Request processed in 284us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596766.266381:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 5 00000100:00100000:1.0:1789596766.270812:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596766.271146:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944865152 00000100:00100000:0.0:1789596766.271158:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944865152 00000100:00100000:0.0:1789596766.271230:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 66 00000100:00100000:0.0:1789596766.271240:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:10440:x1876527944865152:12345-192.168.202.44@tcp:58:lfs.0 00010000:00010000:0.0:1789596766.271337:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7e65 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.271354:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7e65 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.271380:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7e65 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789596766.272270:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789596766.272968:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1789596766.273050:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1789596766.273245:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:10440:x1876527944865152:12345-192.168.202.44@tcp:58:lfs.0 Request processed in 2001us (2437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596766.273256:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 66 00000100:00100000:0.0:1789596766.295920:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596766.296056:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944865280 00000100:00100000:3.0:1789596766.296067:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944865280 00000100:00100000:3.0:1789596766.296125:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 67 00000100:00100000:3.0:1789596766.296136:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:10442:x1876527944865280:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:3.0:1789596766.296156:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596766.296176:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e18 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.296350:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.296366:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.296377:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.296392:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.296398:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.296406:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.296778:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7e81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.296789:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.296806:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596766.296869:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789596766.296873:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789596766.296892:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.296903:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.296911:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.296918:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.296926:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.296932:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596766.296936:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.296943:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.296954:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:3.0:1789596766.296957:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596766.296961:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.296977:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.296989:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.296996:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.297002:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.297007:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596766.297010:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.297016:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.297024:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ea8d1438400) 00010000:00010000:3.0:1789596766.297026:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596766.297029:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.297035:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.297067:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e18 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.297081:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7e81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e18 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.297094:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d55e5200) 00010000:00010000:3.0:1789596766.297096:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789596766.297099:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89600, rc 0) 00000100:00100000:3.0:1789596766.297213:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:10442:x1876527944865280:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 1079us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596766.297289:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 67 00000040:00080000:2.0:1789596766.427081:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789596766.427090:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789596766.427139:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789596766.427147:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789596766.427270:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5708000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876527964812544:192.168.202.44@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789596766.427367:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c313ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789596766.430965:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596766.431010:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944865408 00000100:00100000:3.0:1789596766.431020:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944865408 00000100:00100000:3.0:1789596766.431070:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1 00000100:00100000:3.0:1789596766.431080:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:10453:x1876527944865408:12345-192.168.202.44@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789596766.431167:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef645180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:10453:x1876527944865408:12345-192.168.202.44@tcp:900:lhsmtool_posix.0 Request processed in 89us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596766.431175:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1 00000100:00100000:2.0:1789596766.431443:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5708000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876527964812544:192.168.202.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789596766.434945:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596766.435012:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944865536 00000100:00100000:3.0:1789596766.435023:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944865536 00000100:00100000:3.0:1789596766.435094:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 68 00000100:00100000:3.0:1789596766.435105:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:10453:x1876527944865536:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789596766.435139:0:10902:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789596766.435275:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef764380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:10453:x1876527944865536:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 Request processed in 171us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596766.435283:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 68 00000100:00100000:0.0:1789596766.438511:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596766.438773:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944865664 00000100:00100000:3.0:1789596766.438782:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944865664 00000100:00100000:3.0:1789596766.438875:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 69 00000100:00100000:3.0:1789596766.438885:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:10453:x1876527944865664:12345-192.168.202.44@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789596766.438956:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e88 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.438973:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e88 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.438985:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e88 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439031:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e8f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439039:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439046:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439073:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439080:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439086:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596766.439122:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789596766.439127:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789596766.439143:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439160:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e88 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439166:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e88 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439173:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e88 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439179:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596766.439183:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e88 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439191:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e88 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439202:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ea8d55e5800) 00010000:00010000:3.0:1789596766.439204:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596766.439210:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e88 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439229:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7e88 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439242:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439248:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e8f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439253:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e8f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439265:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596766.439268:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e8f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439274:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e8f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439282:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9ea8d1438400) 00010000:00010000:3.0:1789596766.439285:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596766.439288:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e8f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439294:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7e8f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439312:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439318:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439324:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439330:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596766.439333:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439339:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439359:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d55e5200) 00010000:00010000:3.0:1789596766.439362:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596766.439365:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.439371:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7e96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596766.439751:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:10453:x1876527944865664:12345-192.168.202.44@tcp:34:lhsmtool_posix.0 Request processed in 866us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596766.439761:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 69 00000100:00100000:0.0:1789596766.450030:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596766.451242:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944865920 00000100:00100000:2.0:1789596766.451256:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944865920 00000100:00100000:2.0:1789596766.451320:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 70 00000100:00100000:2.0:1789596766.451331:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:10453:x1876527944865920:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596766.451352:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596766.451373:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7e9d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e1f expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.451480:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7ea4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.451505:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.451528:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596766.451541:0:10902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789596766.451630:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.451638:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7ea4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.451645:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.451652:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596766.451657:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.451665:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7ea4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.451678:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d55e5200) 00010000:00010000:2.0:1789596766.451681:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789596766.451686:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7ea4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.451692:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7ea4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.451730:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7e9d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e1f expref: 23 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.451752:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ea8d55e5800) 00010000:00010000:2.0:1789596766.451754:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789596766.451759:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7e9d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e1f expref: 23 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.451768:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426400, rc 0) 00000100:00100000:2.0:1789596766.451849:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:10453:x1876527944865920:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 521us (1827us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1789596766.451857:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 70 00000100:00100000:0.0:1789596766.455604:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596766.455685:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944866048 00000100:00100000:1.0:1789596766.455697:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944866048 00000100:00100000:1.0:1789596766.455753:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 71 00000100:00100000:1.0:1789596766.455763:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:10453:x1876527944866048:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789596766.455796:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789596766.455939:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:10453:x1876527944866048:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 Request processed in 176us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596766.455947:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 71 00000100:00100000:2.0:1789596766.459661:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596766.459734:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944866304 00000100:00100000:0.0:1789596766.459744:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944866304 00000100:00100000:0.0:1789596766.459803:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 72 00000100:00100000:0.0:1789596766.459812:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:10453:x1876527944866304:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789596766.459856:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596766.459859:0:10902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789596766.459885:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7e5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e11 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.459904:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:0.0:1789596766.459909:0:10902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596766.459923:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7eb2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e26 expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789596766.460727:0:10902:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1789596766.461103:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7eb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.461120:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.461132:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.461187:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7eb2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e26 expref: 24 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.461207:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e26 expref: 23 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.461358:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ea8d55e5b00) 00010000:00010000:0.0:1789596766.461363:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596766.461366:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030e00, rc 0) 00000100:00100000:0.0:1789596766.461482:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5708000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:10453:x1876527944866304:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 1670us (1828us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1789596766.461505:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 72 00000100:00100000:0.0:1789596766.482157:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596766.482241:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944866560 00000100:00100000:3.0:1789596766.482251:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944866560 00000100:00100000:3.0:1789596766.482314:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 73 00000100:00100000:3.0:1789596766.482325:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:10453:x1876527944866560:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789596766.482377:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596766.482402:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7eb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e26 expref: 23 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482422:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ea8d55e5b00) 00010000:00010000:3.0:1789596766.482433:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596766.482465:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7ec7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482478:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7ec7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482500:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7ec7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482529:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7ece lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7a52a37f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482537:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7ece lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7a52a37f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482544:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7ece lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7a52a37f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482739:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7ec7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482747:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7ec7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482754:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7ec7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482760:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596766.482764:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7ec7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482772:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7ec7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482780:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:3.0:1789596766.482783:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596766.482787:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7ec7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482794:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7ec7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482810:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7ece lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7a52a37f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482850:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7ece lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7a52a37f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482856:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7ece lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7a52a37f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482862:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596766.482865:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7ece lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7a52a37f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482871:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7ece lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7a52a37f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482879:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7a52a37f (ffff9ea8d1438400) 00010000:00010000:3.0:1789596766.482882:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596766.482885:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7ece lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7a52a37f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.482890:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7ece lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7a52a37f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596766.482969:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:10453:x1876527944866560:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 Request processed in 645us (821us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789596766.482976:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 73 00000100:00100000:2.0:1789596766.489978:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596766.490065:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944866688 00000100:00100000:3.0:1789596766.490075:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944866688 00000100:00100000:3.0:1789596766.490131:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 74 00000100:00100000:3.0:1789596766.490149:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:10453:x1876527944866688:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596766.490167:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596766.490189:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7ed5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e2d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.490232:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7edc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.490247:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7edc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.490258:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7edc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.490353:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d7ed5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e2d expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.490369:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7edc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e2d expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.490377:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:3.0:1789596766.490380:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789596766.490384:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89c00, rc 0) 00000100:00100000:3.0:1789596766.490439:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:10453:x1876527944866688:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 291us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596766.490602:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 74 00000100:00100000:3.0:1789596766.493029:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596766.493115:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944866944 00000100:00100000:2.0:1789596766.493126:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944866944 00000100:00100000:2.0:1789596766.493187:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 75 00000100:00100000:2.0:1789596766.493198:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:10453:x1876527944866944:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789596766.493280:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7ee3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.493296:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.493307:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789596766.493597:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1789596766.493608:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351457790567ns, next at 352457788200ns, rc = 0 00000004:00010000:2.0:1789596766.493690:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048dec356 reply state 00000000d9b4d71a transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596766.493713:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789596766.493798:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+25:10453:x1876527944866944:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 Request processed in 602us (777us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1789596766.493805:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 75 00010000:00010000:3.0:1789596766.498406:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.498454:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7ee3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.498464:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7ee3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.498471:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596766.498476:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7ee3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.498492:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7ee3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.498512:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:3.0:1789596766.498515:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789596766.498521:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7ee3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.498529:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d7ee3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596766.498802:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596766.499253:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944867072 00000100:00100000:3.0:1789596766.499264:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944867072 00000100:00100000:3.0:1789596766.499323:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 76 00000100:00100000:3.0:1789596766.499333:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+24:10453:x1876527944867072:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596766.499359:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596766.499379:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7eea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e34 expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.499433:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7eea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e34 expref: 25 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.499563:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7eea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e34 expref: 25 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.499583:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:3.0:1789596766.499586:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789596766.499588:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88800, rc 0) 00000100:00100000:3.0:1789596766.499644:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+25:10453:x1876527944867072:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 312us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596766.499651:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 76 00000100:00100000:1.0:1789596766.506039:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596766.506156:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944867200 00000100:00100000:3.0:1789596766.506166:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944867200 00000100:00100000:3.0:1789596766.506211:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 25 00000100:00100000:3.0:1789596766.506231:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1876527944867200:12345-192.168.202.44@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789596766.506265:0:9219:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:3.0:1789596766.506299:0:9219:0:(genops.c:1384:class_connect()) connect: client 1fdd0e7b-fe25-4537-b350-ae6aecfab059, cookie 0x8973ae90b38d7ef1 00002000:00100000:3.0:1789596766.506311:0:9219:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1fdd0e7b-fe25-4537-b350-ae6aecfab059/ffff9ea8d2e19800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789596766.506323:0:9219:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789596766.506595:0:9219:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789596766.506625:0:9219:0:(import.c:65:import_set_state_nolock()) ffff9ea8d2e1a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789596766.506741:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2350:x1876527944867200:12345-192.168.202.44@tcp:8:lhsmtool_posix.0 Request processed in 519us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596766.506750:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 25 00000100:00100000:3.0:1789596766.513159:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596766.513292:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944867328 00000100:00100000:0.0:1789596766.513303:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944867328 00000100:00100000:0.0:1789596766.513384:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 26 00000100:00100000:0.0:1789596766.513395:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:0:x1876527944867328:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789596766.515174:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789596766.550785:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1789596766.550803:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1fdd0e7b-fe25-4537-b350-ae6aecfab059 00000100:00100000:0.0:1789596766.551094:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef645880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:0:x1876527944867328:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 Request processed in 37694us (37938us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789596766.551106:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 26 00000100:00100000:0.0:1789596766.553574:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596766.553733:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944867584 00000100:00100000:2.0:1789596766.553744:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944867584 00000100:00100000:2.0:1789596766.553803:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 19 00000100:00100000:2.0:1789596766.553812:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+25:10453:x1876527944867584:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789596766.554159:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:10453:x1876527944867584:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 Request processed in 346us (592us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789596766.554167:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 19 00000100:00100000:3.0:1789596766.555887:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596766.555999:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944867840 00000100:00100000:2.0:1789596766.556009:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944867840 00000100:00100000:2.0:1789596766.556061:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 77 00000100:00100000:2.0:1789596766.556071:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:10453:x1876527944867840:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789596766.556162:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef644700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:10453:x1876527944867840:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 Request processed in 93us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596766.556170:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 77 00000100:00100000:3.0:1789596766.558426:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596766.558543:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944867968 00000100:00100000:2.0:1789596766.558553:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944867968 00000100:00100000:2.0:1789596766.558621:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 78 00000100:00100000:2.0:1789596766.558631:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:10453:x1876527944867968:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596766.558667:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596766.558689:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7ef8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e3b expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.558755:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7eff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.558770:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7eff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.558782:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7eff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596766.558857:0:10902:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789596766.558878:0:10902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7eff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.558906:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7ef8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e3b expref: 28 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.558926:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7eff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e3b expref: 27 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.558935:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:2.0:1789596766.558938:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789596766.558941:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426c00, rc 0) 00000100:00100000:2.0:1789596766.559001:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef644e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:10453:x1876527944867968:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 371us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596766.559008:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 78 00000100:00100000:0.0:1789596766.561798:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596766.561922:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944868096 00000100:00100000:3.0:1789596766.561933:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944868096 00000100:00100000:3.0:1789596766.561995:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 27 00000100:00100000:3.0:1789596766.562008:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2353:x1876527944868096:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596766.562030:0:9219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596766.562051:0:9219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006085bede/0x8973ae90b38d7f06 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e42 expref: -99 pid: 9219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789596766.562080:0:9219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab145e, blocks: 0x1 00010000:00010000:3.0:1789596766.562099:0:9219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=351s v=(0 0) 00010000:00010000:3.0:1789596766.562103:0:9219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596766.562113:0:9219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006085bede/0x8973ae90b38d7f06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e42 expref: 6 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.562132:0:9219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006085bede/0x8973ae90b38d7f06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e42 expref: 6 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.562145:0:9219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88c00, rc 0) 00000100:00100000:3.0:1789596766.562200:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2353:x1876527944868096:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 195us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596766.562206:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 27 00000100:00100000:1.0:1789596766.570806:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596766.570932:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944868352 00000100:00100000:3.0:1789596766.570944:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944868352 00000100:00100000:3.0:1789596766.570993:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 79 00000100:00100000:3.0:1789596766.571004:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:10453:x1876527944868352:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789596766.571132:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:10453:x1876527944868352:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 Request processed in 129us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596766.571140:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 79 00000100:00100000:3.0:1789596766.573548:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596766.573792:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944868480 00000100:00100000:1.0:1789596766.573802:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944868480 00000100:00100000:1.0:1789596766.573887:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 28 00000100:00100000:1.0:1789596766.573896:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:10453:x1876527944868480:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789596766.573915:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596766.573937:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d453fdde/0x8973ae90b38d7f0d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e49 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.573988:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006085bede/0x8973ae90b38d7f06 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e42 expref: 7 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.573998:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596766.574002:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596766.574008:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d453fdde/0x8973ae90b38d7f0d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e49 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.574038:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006085bede/0x8973ae90b38d7f06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e42 expref: 7 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.574051:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006085bede/0x8973ae90b38d7f06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e42 expref: 7 pid: 9219 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596766.574066:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef64b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1876527964812672:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789596766.574162:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c51b79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596766.577429:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596766.578323:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944868608 00000100:00100000:1.0:1789596766.578335:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944868608 00010000:00010000:1.0:1789596766.578378:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006085bede/0x8973ae90b38d7f06 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e42 expref: 8 pid: 9219 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596766.578414:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 42 00000100:00100000:1.0:1789596766.578424:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c8280450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2354:x1876527944868608:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596766.578440:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596766.578491:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006085bede/0x8973ae90b38d7f06 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e42 expref: 8 pid: 9219 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.578506:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006085bede/0x8973ae90b38d7f06 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e42 expref: 8 pid: 9219 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.578533:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596766.578537:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596766.578546:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d453fdde/0x8973ae90b38d7f0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e49 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.578557:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d453fdde/0x8973ae90b38d7f0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e49 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.578728:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d453fdde/0x8973ae90b38d7f0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e49 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596766.578743:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef648380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1876527964812800:192.168.202.44@tcp:105: 00000100:00100000:1.0:1789596766.578850:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c51b7c00 going to sleep for 11 seconds 00010000:00010000:1.0:1789596766.581507:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006085bede/0x8973ae90b38d7f06 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e42 expref: 8 pid: 9219 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596766.581529:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef64b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1876527964812672:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596766.581558:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d453fdde/0x8973ae90b38d7f0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e49 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.581585:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a33200, rc 0) 00000100:00100000:1.0:1789596766.596220:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:10453:x1876527944868480:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 22312us (22669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596766.596235:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 28 00000100:00100000:2.0:1789596766.598792:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef648380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1876527964812800:192.168.202.44@tcp:105: 00010000:00010000:2.0:1789596766.598833:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596766.598882:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c8280450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2354:x1876527944868608:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 20458us (21461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596766.598893:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 42 00000100:00100000:2.0:1789596766.603415:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596766.603871:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944868736 00000100:00100000:1.0:1789596766.603882:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944868736 00002000:00100000:1.0:1789596766.603934:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ea8fa253800 x1876527944868736/t0(0) o4->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:647/0 lens 504/0 e 0 to 0 dl 1789596777 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789596766.603946:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8fa253800 with x1876527944868736 ext(0->8) 00002000:00010000:1.0:1789596766.603952:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ea8fa253800 00000100:00100000:1.0:1789596766.603987:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 0 00000100:00100000:1.0:1789596766.603997:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2354:x1876527944868736:12345-192.168.202.44@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789596766.604575:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2354:x1876527944868736:12345-192.168.202.44@tcp:4:lhsmtool_posix.0 Request processed in 578us (1167us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789596766.604583:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 0 00002000:00100000:1.0:1789596766.604590:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ea8fa253800 x1876527944868736/t4294967302(0) o4->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:647/0 lens 504/448 e 0 to 0 dl 1789596777 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789596766.604599:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8fa253800 with x1876527944868736 ext(0->8) 00002000:00010000:1.0:1789596766.604602:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ea8fa253800 00000100:00100000:0.0:1789596766.607360:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596766.607553:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944868864 00000100:00100000:2.0:1789596766.607563:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944868864 00000100:00100000:2.0:1789596766.607630:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 80 00000100:00100000:2.0:1789596766.607641:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:10453:x1876527944868864:12345-192.168.202.44@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789596766.697429:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:10453:x1876527944868864:12345-192.168.202.44@tcp:44:lhsmtool_posix.0 Request processed in 89780us (90069us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596766.697451:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 80 00000001:00080000:2.0:1789596766.698872:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:2.0:1789596766.698898:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1789596766.698904:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1789596766.698930:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1789596766.698962:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1789596766.698970:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789596766.699528:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596766.699561:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944868992 00000100:00100000:3.0:1789596766.699570:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944868992 00000100:00100000:3.0:1789596766.699625:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 29 00000100:00100000:3.0:1789596766.699634:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2353:x1876527944868992:12345-192.168.202.44@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789596766.700137:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964812928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789596766.700190:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596766.700419:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964812928 00000100:00100000:3.0:1789596766.700424:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964812928 00000100:00100000:3.0:1789596766.700468:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789596766.700476:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964812928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789596766.700630:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789596766.700633:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789596766 00002000:00010000:3.0:1789596766.700636:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789596766.700638:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789596766 -> 1789596766 00002000:00010000:3.0:1789596766.700640:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789596766.700679:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1876527964812928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 204us (488us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789596766.700686:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:2.0:1789596766.700764:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ea8ef645f80/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789596766.700771:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef645f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964812928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789596766.747464:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964813440:0@lo:400:kworker.0 00000100:00100000:2.0:1789596766.747540:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596766.747588:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789596766.747605:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964813056:0@lo:400:kworker.0 00000100:00100000:2.0:1789596766.747632:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596766.747653:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964813568:0@lo:400:kworker.0 00000100:00100000:2.0:1789596766.747678:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596766.747701:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964813184:0@lo:400:kworker.0 00000100:00100000:2.0:1789596766.747723:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596766.747743:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596766.747749:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f7495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964813312:0@lo:400:kworker.0 00000100:00100000:2.0:1789596766.747769:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596766.748161:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964813440 00000100:00100000:0.0:1789596766.748169:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964813440 00000100:00100000:0.0:1789596766.748238:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964813184 00000100:00100000:0.0:1789596766.748241:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964813184 00000100:00100000:0.0:1789596766.748252:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964813312 00000100:00100000:0.0:1789596766.748254:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964813312 00000100:00100000:0.0:1789596766.748267:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789596766.748275:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964813440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596766.748328:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964813440:12345-0@lo:400:kworker.0 Request processed in 54us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596766.748335:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789596766.748351:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789596766.748357:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964813184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596766.748390:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964813184:12345-0@lo:400:kworker.0 Request processed in 32us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596766.748396:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789596766.748406:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789596766.748412:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964813312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596766.748437:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964813312:12345-0@lo:400:kworker.0 Request processed in 25us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596766.748570:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789596766.748617:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964813440:0@lo:400:kworker.0 00000100:00100000:0.0:1789596766.748647:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f7495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964813312:0@lo:400:kworker.0 00000100:00100000:0.0:1789596766.748656:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5709500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964813184:0@lo:400:kworker.0 00000100:00100000:3.0:1789596766.750604:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964813056 00000100:00100000:3.0:1789596766.750617:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964813056 00000100:00100000:3.0:1789596766.750664:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789596766.750673:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964813056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596766.750770:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964813056:12345-0@lo:400:kworker.0 Request processed in 99us (3136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596766.750778:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789596766.751185:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964813568 00000100:00100000:3.0:1789596766.751190:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964813568 00000100:00100000:3.0:1789596766.751231:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789596766.751238:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1876527964813568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596766.751280:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1876527964813568:12345-0@lo:400:kworker.0 Request processed in 42us (3601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596766.751286:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789596766.751690:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964813056:0@lo:400:kworker.0 00000100:00100000:0.0:1789596766.751708:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964813568:0@lo:400:kworker.0 00000100:00080000:2.0:1789596766.752328:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789596766.752334:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789596766.808716:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:2.0:1789596766.808751:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1789596766.809632:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2353:x1876527944868992:12345-192.168.202.44@tcp:16:lhsmtool_posix.0 Request processed in 109991us (110101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596766.809644:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 29 00000100:00100000:2.0:1789596766.824134:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596766.826657:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944869248 00000100:00100000:0.0:1789596766.826670:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944869248 00000100:00100000:0.0:1789596766.826731:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 81 00000100:00100000:0.0:1789596766.826742:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:10453:x1876527944869248:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789596766.826798:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596766.826855:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7eff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e3b expref: 13 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.826873:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:0.0:1789596766.826878:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596766.826907:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.826921:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.826931:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789596766.828714:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e295e360 reply state 0000000018b52bfa transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596766.828729:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789596766.828873:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:10453:x1876527944869248:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 Request processed in 2130us (4747us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789596766.828881:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 81 00010000:00010000:1.0:1789596766.832784:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.832803:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.832845:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.832852:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596766.832857:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.832865:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.832881:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:1.0:1789596766.832884:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596766.832889:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.832894:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596766.845063:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596766.845154:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944869376 00000100:00100000:1.0:1789596766.845165:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944869376 00000100:00100000:1.0:1789596766.845225:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 31 00000100:00100000:1.0:1789596766.845236:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2354:x1876527944869376:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789596766.845501:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789596766.845505:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789596766 -> 1789596765 00002000:00010000:1.0:1789596766.845508:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789596764 00002000:00010000:1.0:1789596766.845509:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789596766 -> 1789596765 00002000:00010000:1.0:1789596766.845512:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789596766.845576:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2354:x1876527944869376:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 Request processed in 341us (522us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789596766.845595:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 31 00000100:00100000:1.0:1789596766.854981:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596766.855055:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944869632 00000100:00100000:2.0:1789596766.855065:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944869632 00000100:00100000:2.0:1789596766.855129:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 82 00000100:00100000:2.0:1789596766.855140:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:10453:x1876527944869632:12345-192.168.202.44@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789596766.855221:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7f1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.855240:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7edc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e2d expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.855249:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7f1b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.855295:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7edc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e2d expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.855309:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7edc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e2d expref: 13 pid: 5841 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596766.855325:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6524700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1876527964813696:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789596766.855409:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d353e180 going to sleep for 11 seconds 00000100:00100000:1.0:1789596766.859034:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6524700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1876527964813696:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596766.859068:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7f1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596766.859139:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596766.859205:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944869760 00000100:00100000:1.0:1789596766.859222:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944869760 00010000:00010000:1.0:1789596766.859256:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7edc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e2d expref: 14 pid: 5841 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596766.859296:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 43 00000100:00100000:1.0:1789596766.859306:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:2353:x1876527944869760:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596766.859320:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596766.859326:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7edc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e2d expref: 14 pid: 5841 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.859338:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7edc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e2d expref: 14 pid: 5841 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.859358:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d7edc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e2d expref: 14 pid: 5841 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.859373:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:1.0:1789596766.859378:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7f1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.859403:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7f1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.859411:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7f1b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.859433:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596766.859498:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:2353:x1876527944869760:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 193us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596766.859505:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 43 00010000:00010000:1.0:1789596766.859752:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7f1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.859759:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7f1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.859786:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7f1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.859792:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7f1b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.859798:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7f1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.859803:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427a00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596766.859807:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7f1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.859841:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7f1b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.859858:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:1.0:1789596766.859860:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789596766.859864:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7f1b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.859871:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7f1b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596766.859914:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+12:10453:x1876527944869632:12345-192.168.202.44@tcp:55:lhsmtool_posix.0 Request processed in 4777us (4945us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789596766.859921:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 82 00000100:00100000:2.0:1789596766.865532:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596766.865642:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944869888 00000100:00100000:3.0:1789596766.865652:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944869888 00000100:00100000:3.0:1789596766.865713:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 32 00000100:00100000:3.0:1789596766.865723:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2354:x1876527944869888:12345-192.168.202.44@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789596766.865765:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d7f22 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.865786:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d453fdde/0x8973ae90b38d7f0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e49 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.865795:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596766.865800:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789596766.865804:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d7f22 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.865882:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d453fdde/0x8973ae90b38d7f0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e49 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.865898:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d453fdde/0x8973ae90b38d7f0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e49 expref: 7 pid: 6692 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596766.865913:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef644380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1876527964813824:192.168.202.44@tcp:104: 00000100:00100000:3.0:1789596766.865990:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff4b09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596766.868676:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef644380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1876527964813824:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789596766.868710:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d7f22 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596766.872127:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596766.873141:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944870016 00000100:00100000:0.0:1789596766.873155:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944870016 00010000:00010000:0.0:1789596766.873200:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d453fdde/0x8973ae90b38d7f0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e49 expref: 8 pid: 6692 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596766.873335:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 44 00000100:00100000:0.0:1789596766.873346:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff389880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2354:x1876527944870016:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596766.873362:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596766.873384:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d453fdde/0x8973ae90b38d7f0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e49 expref: 8 pid: 6692 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.873399:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d453fdde/0x8973ae90b38d7f0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e49 expref: 8 pid: 6692 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.873422:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d453fdde/0x8973ae90b38d7f0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e49 expref: 8 pid: 6692 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.873438:0:7644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789596766.873450:0:7644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789596766.873469:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d7f22 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.873488:0:7644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d7f22 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.873524:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596766.873669:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d7f22 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.873679:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d7f22 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.873707:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d7f22 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.873717:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d7f22 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.873738:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d7f22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.873745:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88400 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:3.0:1789596766.873750:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d7f22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.873759:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d7f22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.873772:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d7f22 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.873779:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d7f22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596766.874001:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2354:x1876527944869888:12345-192.168.202.44@tcp:1:lhsmtool_posix.0 Request processed in 8278us (8481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596766.874009:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 32 00000100:00100000:0.0:1789596766.874097:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff389880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2354:x1876527944870016:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 246us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596766.874104:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 44 00000100:00100000:2.0:1789596766.877029:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596766.877099:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944870272 00000100:00100000:3.0:1789596766.877108:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944870272 00000100:00100000:3.0:1789596766.877198:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 83 00000100:00100000:3.0:1789596766.877208:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+12:10453:x1876527944870272:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789596766.877297:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.877325:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.877338:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.877689:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7f30 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.877702:0:10902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7eea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e34 expref: 13 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.877710:0:10902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7f30 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.877743:0:10902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7eea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e34 expref: 13 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596766.877756:0:10902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7eea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e34 expref: 13 pid: 10902 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596766.877770:0:10902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef644380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10902:1876527964813952:192.168.202.44@tcp:104: 00000100:00100000:3.0:1789596766.877871:0:10902:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff4b09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596766.882337:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596766.882469:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944870400 00000100:00100000:2.0:1789596766.882505:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944870400 00010000:00010000:2.0:1789596766.882548:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7eea lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e34 expref: 14 pid: 10902 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596766.882598:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 45 00000100:00100000:2.0:1789596766.882609:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:2354:x1876527944870400:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596766.882623:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596766.882630:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7eea lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e34 expref: 14 pid: 10902 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.882644:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7eea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e34 expref: 14 pid: 10902 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.882685:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:2.0:1789596766.882691:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7f30 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.882700:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7f30 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.882708:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7f30 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.882726:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596766.882785:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:2354:x1876527944870400:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 179us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596766.882793:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 45 00010000:00010000:3.0:1789596766.884182:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7eea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e34 expref: 13 pid: 10902 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596766.884205:0:10902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef644380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10902:1876527964813952:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789596766.884241:0:10902:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7f30 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.884375:0:10902:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7f30 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.884383:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7f30 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789596766.884803:0:10902:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1789596766.886568:0:10902:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1789596766.886658:0:10902:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1789596766.886750:0:10902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef764000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10902:1876527964814080:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789596766.886999:0:10902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596766.887074:0:10902:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c2f96d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789596766.887124:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964814080 00000100:00100000:1.0:1789596766.887133:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964814080 00000100:00100000:1.0:1789596766.887306:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789596766.887316:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10902:x1876527964814080:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789596766.887404:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10902:x1876527964814080:12345-0@lo:1000:mdt00_003.0 Request processed in 89us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596766.887412:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789596766.887476:0:10902:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1789596766.887490:0:10902:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ea8ef645f80, transno 4294967303 00000100:00100000:0.0:1789596766.887509:0:10902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef764000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10902:1876527964814080:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789596766.887987:0:10902:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1789596766.888054:0:10902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef764000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10902:1876527964814208:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789596766.888089:0:10902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596766.888645:0:10902:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c533a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596766.888678:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964814208 00000100:00100000:2.0:1789596766.888685:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964814208 00000100:00100000:2.0:1789596766.888719:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789596766.888727:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10902:x1876527964814208:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789596766.889067:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10902:x1876527964814208:12345-0@lo:1000:mdt00_003.0 Request processed in 340us (975us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789596766.889075:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789596766.889206:0:10902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef764000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10902:1876527964814208:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789596766.889307:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7f30 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.889318:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7f30 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.889326:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7f30 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.889333:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596766.889337:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7f30 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.889345:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7f30 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.889361:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:0.0:1789596766.889364:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789596766.889370:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7f30 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.889377:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d7f30 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.889417:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7e65 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.889424:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7e65 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.889430:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7e65 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.889526:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596766.889530:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7e65 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.889537:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7e65 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.889546:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d55e5200) 00010000:00010000:0.0:1789596766.889549:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789596766.889552:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7e65 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.889558:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d7e65 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.889581:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f37 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.889597:0:10902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7e81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e18 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.889606:0:10902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f37 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.889638:0:10902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7e81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e18 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.889653:0:10902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7e81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e18 expref: 16 pid: 5842 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596766.889678:0:10902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef764a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10902:1876527964814336:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789596766.889798:0:10902:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c533a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596766.893452:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596766.893552:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944870528 00000100:00100000:1.0:1789596766.893562:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944870528 00010000:00010000:1.0:1789596766.893619:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7e81 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e18 expref: 17 pid: 5842 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596766.893661:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 46 00000100:00100000:1.0:1789596766.893673:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+17:2354:x1876527944870528:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596766.893690:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596766.893712:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7e81 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e18 expref: 17 pid: 5842 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.893727:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7e81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e18 expref: 17 pid: 5842 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.893749:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d55e5200) 00010000:00010000:1.0:1789596766.893755:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f37 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.893765:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.893773:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f37 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596766.893794:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596766.893889:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef765880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+17:2354:x1876527944870528:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 218us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596766.893897:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 46 00010000:00010000:2.0:1789596766.894159:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7e81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e18 expref: 16 pid: 5842 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596766.894174:0:10902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef764a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10902:1876527964814336:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789596766.894194:0:10902:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.894213:0:10902:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.894219:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.894233:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.894239:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f37 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.894246:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f37 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.894252:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596766.894257:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f37 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.894265:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f37 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.894274:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d55e5200) 00010000:00010000:2.0:1789596766.894277:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596766.894281:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f37 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.894286:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d7f37 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.894297:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.894310:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f29 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.894316:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.894321:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596766.894324:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.894330:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f29 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.894338:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d55e5200) 00010000:00010000:2.0:1789596766.894341:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789596766.894343:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f29 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.894348:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596766.894567:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+15:10453:x1876527944870272:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 Request processed in 17360us (17548us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1789596766.894575:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 83 00000020:00080000:2.0:1789596766.894580:0:10902:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789596766.894716:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789596766.894721:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789596766.894747:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789596766.894754:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789596766.898793:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596766.898935:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944870784 00000100:00100000:2.0:1789596766.898945:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944870784 00000100:00100000:2.0:1789596766.899002:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 20 00000100:00100000:2.0:1789596766.899013:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+15:10453:x1876527944870784:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789596766.899743:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789596766.899869:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1789596766.899919:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7f3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.899940:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7f3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.899953:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7f3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.899961:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7f3e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.899968:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7f3e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.899975:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7f3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596766.899991:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789596766.900099:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+17:10453:x1876527944870784:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 Request processed in 1087us (1315us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789596766.900108:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 20 00000020:00080000:2.0:1789596766.900113:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789596766.901089:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596766.901102:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7f3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.901112:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596766.901116:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7f3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.901126:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7f3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.901142:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ea8e0eeae00) 00010000:00010000:0.0:1789596766.901145:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789596766.901150:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7f3e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.901156:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d7f3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596766.901181:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596766.901183:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596766.901185:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789596767.114446:0:12015:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789596767.114458:0:12015:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789596767.123727:0:12015:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789596767.123741:0:12015:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789596767.133438:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596767.260641:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596767.260663:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964814464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596767.260731:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596767.260804:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964814464 00000100:00100000:0.0:1789596767.260811:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964814464 00000100:00100000:0.0:1789596767.260880:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789596767.260890:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876527964814464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596767.260927:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596767.260974:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876527964814464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596767.260982:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789596767.261030:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef764e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964814464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596767.275977:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596767.276072:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944871040 00000100:00100000:3.0:1789596767.276082:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944871040 00000100:00100000:3.0:1789596767.276134:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 84 00000100:00100000:3.0:1789596767.276145:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+17:10463:x1876527944871040:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:3.0:1789596767.276169:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596767.276189:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7f45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e50 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.276337:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7f4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.276352:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7f4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.276363:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7f4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596767.276374:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789596767.276558:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7f45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e50 expref: 20 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.276575:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7f4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e50 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.276718:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:3.0:1789596767.276722:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789596767.276726:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88800, rc 0) 00000100:00100000:3.0:1789596767.276786:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:10463:x1876527944871040:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 642us (819us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789596767.276920:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 84 00000100:00100000:3.0:1789596767.283056:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596767.284877:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944871168 00000100:00100000:1.0:1789596767.284889:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944871168 00000100:00100000:1.0:1789596767.284944:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 85 00000100:00100000:1.0:1789596767.284954:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:10463:x1876527944871168:12345-192.168.202.44@tcp:34:lfs.0 00010000:00010000:1.0:1789596767.285026:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d7f5a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285044:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d7f5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285064:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d7f5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285081:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d7f61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285088:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d7f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285095:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d7f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285327:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285337:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285345:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789596767.285383:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285396:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d7f5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285403:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d7f5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285410:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d7f5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285425:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596767.285430:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d7f5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285439:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d7f5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285452:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:1.0:1789596767.285455:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596767.285459:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d7f5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285466:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d7f5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285490:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d7f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285496:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d7f61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285514:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d7f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285520:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a33800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596767.285523:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d7f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285529:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d7f61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285546:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ea8c36d5800) 00010000:00010000:1.0:1789596767.285549:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596767.285552:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d7f61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285558:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d7f61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285572:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285578:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285584:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285589:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596767.285592:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285599:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285606:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8c36d5900) 00010000:00010000:1.0:1789596767.285609:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596767.285612:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.285618:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596767.285714:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef645f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:10463:x1876527944871168:12345-192.168.202.44@tcp:34:lfs.0 Request processed in 760us (2664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596767.285723:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 85 00000100:00100000:2.0:1789596767.331095:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596767.331157:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944871424 00000100:00100000:3.0:1789596767.331167:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944871424 00000100:00100000:3.0:1789596767.331237:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 86 00000100:00100000:3.0:1789596767.331247:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff38ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:10466:x1876527944871424:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:3.0:1789596767.331268:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596767.331290:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d7f6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.331357:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7f76 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.331372:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7f76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.331383:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7f76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.331400:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.331408:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.331426:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.332045:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7f84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.332055:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7f84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.332064:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7f84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596767.332074:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789596767.332164:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7f76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.332172:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7f76 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.332180:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7f76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.332187:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596767.332191:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7f76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.332200:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7f76 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.332267:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:3.0:1789596767.332271:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596767.332284:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7f76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.332290:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d7f76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.332303:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.332308:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.332314:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.332319:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596767.332322:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.332328:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.332335:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ea8d1438400) 00010000:00010000:3.0:1789596767.332338:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596767.332341:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.332347:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d7f7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.332392:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d7f6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e57 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.332417:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7f84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e57 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.332424:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d1438d00) 00010000:00010000:3.0:1789596767.332427:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596767.332430:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89600, rc 0) 00000100:00100000:3.0:1789596767.332569:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff38ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:10466:x1876527944871424:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 1322us (1480us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789596767.332577:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 86 00000100:00100000:3.0:1789596767.339950:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596767.341419:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944871552 00000100:00100000:1.0:1789596767.341443:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944871552 00000100:00100000:1.0:1789596767.341551:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 87 00000100:00100000:1.0:1789596767.341570:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:10466:x1876527944871552:12345-192.168.202.44@tcp:54:lfs.0 00010000:00010000:1.0:1789596767.341671:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.341701:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.341720:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.341760:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.341771:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.341784:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.341795:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596767.341802:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.341863:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.341900:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d1438d00) 00010000:00010000:1.0:1789596767.341906:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789596767.341913:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.341925:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7f92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596767.342038:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef644380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:10466:x1876527944871552:12345-192.168.202.44@tcp:54:lfs.0 Request processed in 475us (2095us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596767.342045:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 87 00000100:00100000:3.0:1789596767.357766:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596767.360774:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944871808 00000100:00100000:2.0:1789596767.360787:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944871808 00000100:00100000:2.0:1789596767.360873:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 21 00000100:00100000:2.0:1789596767.360894:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3553050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:10466:x1876527944871808:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:2.0:1789596767.361147:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3553050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:10466:x1876527944871808:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 256us (3392us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1789596767.361156:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 21 00000100:00100000:0.0:1789596767.406404:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596767.407472:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944872064 00000100:00100000:2.0:1789596767.407496:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944872064 00000100:00100000:2.0:1789596767.407555:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 88 00000100:00100000:2.0:1789596767.407564:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:9994:x1876527944872064:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:2.0:1789596767.407587:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596767.407619:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7f99 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e5e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.407715:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7fa0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.407730:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7f84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e57 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.407738:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7fa0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.407770:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7f84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e57 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.407784:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7f84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e57 expref: 23 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596767.407797:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1876527964814592:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789596767.407915:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d353e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789596767.412342:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1876527964814592:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789596767.412380:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7fa0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596767.423977:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596767.424129:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944872192 00000100:00100000:2.0:1789596767.424140:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944872192 00010000:00010000:2.0:1789596767.424182:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7f84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e57 expref: 24 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596767.424227:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 47 00000100:00100000:2.0:1789596767.424237:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+24:2353:x1876527944872192:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596767.424251:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596767.424258:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7f84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e57 expref: 24 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.424272:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7f84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e57 expref: 24 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.424294:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d7f84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e57 expref: 24 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.424309:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d1438d00) 00010000:00010000:2.0:1789596767.424314:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7fa0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.424323:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7fa0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.424348:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7fa0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.424376:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596767.424423:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:2353:x1876527944872192:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 187us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596767.424430:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 47 00010000:00010000:3.0:1789596767.424641:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7fa0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.424650:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7fa0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596767.424677:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789596767.424853:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d7f99 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e5e expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.424870:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7fa0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e5e expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.424878:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d1438d00) 00010000:00010000:3.0:1789596767.424880:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789596767.424889:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427800, rc 0) 00000100:00100000:3.0:1789596767.424925:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef764e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:9994:x1876527944872064:12345-192.168.202.44@tcp:101:bash.0 Request processed in 17362us (18530us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789596767.424933:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 88 00000100:00100000:0.0:1789596767.432240:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596767.432724:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944872448 00000100:00100000:1.0:1789596767.432734:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944872448 00000100:00100000:1.0:1789596767.432795:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 89 00000100:00100000:1.0:1789596767.432805:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:9994:x1876527944872448:12345-192.168.202.44@tcp:36:bash.0 00010000:00010000:1.0:1789596767.433103:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7fae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.433120:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7fae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.433133:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7fae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789596767.433180:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1789596767.433205:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e38b521 reply state 0000000086bdd830 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7fae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596767.433214:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789596767.433276:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1789596767.433378:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:9994:x1876527944872448:12345-192.168.202.44@tcp:36:bash.0 Request processed in 574us (1146us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1789596767.433386:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 89 00000020:00080000:1.0:1789596767.433392:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789596767.435805:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00010000:00010000:3.0:1789596767.436265:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7fae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.436279:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7fae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.436288:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7fae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.436295:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596767.436300:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7fae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.436309:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7fae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.436325:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d1438d00) 00010000:00010000:3.0:1789596767.436328:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596767.436333:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7fae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.436339:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d7fae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596767.438966:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944872576 00000100:00100000:0.0:1789596767.438981:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944872576 00000100:00100000:0.0:1789596767.439054:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 90 00000100:00100000:0.0:1789596767.439064:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:9994:x1876527944872576:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:0.0:1789596767.439089:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596767.439109:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7fb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e65 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.439166:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e65 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.439181:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7fb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e65 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.439199:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d1438d00) 00010000:00010000:0.0:1789596767.439214:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789596767.439218:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030c00, rc 0) 00000100:00100000:0.0:1789596767.439279:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:9994:x1876527944872576:12345-192.168.202.44@tcp:101:bash.0 Request processed in 217us (3481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596767.439286:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 90 00000100:00100000:3.0:1789596767.443905:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596767.444173:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944872704 00000100:00100000:1.0:1789596767.444184:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944872704 00000100:00100000:1.0:1789596767.444242:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 33 00000100:00100000:1.0:1789596767.444253:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:9994:x1876527944872704:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:1.0:1789596767.444271:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596767.444292:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005944294f/0x8973ae90b38d7fbc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e6c expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789596767.444318:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aab145d, atime: 0x6aab145c, ctime: 0x6aab145d, blocks: 0xb 00010000:00010000:1.0:1789596767.444338:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=352s v=(0 0) 00010000:00010000:1.0:1789596767.444342:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596767.444351:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005944294f/0x8973ae90b38d7fbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e6c expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.444369:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005944294f/0x8973ae90b38d7fbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e6c expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.444382:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32200, rc 0) 00000100:00100000:1.0:1789596767.444441:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef646d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:9994:x1876527944872704:12345-192.168.202.44@tcp:101:bash.0 Request processed in 189us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596767.444448:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 33 00000100:00100000:1.0:1789596767.447291:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596767.447370:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944872832 00000100:00100000:2.0:1789596767.447381:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944872832 00002000:00010000:2.0:1789596767.447419:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1789596767.447424:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8ef64a680 with x1876527944872832 ext(0->18446744073709551615) 00002000:00010000:2.0:1789596767.447515:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ea8ef64a680. 00000100:00100000:2.0:1789596767.447551:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1 00000100:00100000:2.0:1789596767.447562:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2354:x1876527944872832:12345-192.168.202.44@tcp:10:bash.0 00002000:00010000:2.0:1789596767.447860:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789596767.447864:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789596765 -> 1789596767 00002000:00010000:2.0:1789596767.447867:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789596764 -> 1789596764 00002000:00010000:2.0:1789596767.447869:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789596765 -> 1789596767 00002000:00010000:2.0:1789596767.447871:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789596767.447932:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2354:x1876527944872832:12345-192.168.202.44@tcp:10:bash.0 Request processed in 372us (650us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789596767.447940:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1 00002000:00010000:2.0:1789596767.447944:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1789596767.447946:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8ef64a680 with x1876527944872832 ext(0->18446744073709551615) 00002000:00010000:2.0:1789596767.447951:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ea8ef64a680. 00000100:00100000:2.0:1789596767.517805:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596767.518087:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944872960 00000100:00100000:1.0:1789596767.518098:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944872960 00000100:00100000:2.0:1789596767.518301:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 91 00000100:00100000:2.0:1789596767.518316:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d1428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:10480:x1876527944872960:12345-192.168.202.44@tcp:34:lfs.0 00010000:00010000:2.0:1789596767.518386:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fc3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518403:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518415:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518431:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518438:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518445:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518674:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7fd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518684:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518691:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596767.518730:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518751:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518757:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fc3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518763:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518768:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596767.518773:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518781:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fc3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518793:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:2.0:1789596767.518796:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596767.518800:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518806:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518847:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518853:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518859:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518869:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427a00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596767.518872:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518878:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518885:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ea8e0eea000) 00010000:00010000:2.0:1789596767.518888:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596767.518890:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518895:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518909:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518915:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7fd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518920:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518925:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596767.518928:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518934:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7fd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518950:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d1438d00) 00010000:00010000:2.0:1789596767.518952:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596767.518955:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7fd1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.518962:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7fd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596767.519088:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d1428380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:10480:x1876527944872960:12345-192.168.202.44@tcp:34:lfs.0 Request processed in 777us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596767.519097:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 91 00000100:00100000:3.0:1789596767.546005:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596767.546118:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944873216 00000100:00100000:2.0:1789596767.546129:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944873216 00000100:00100000:2.0:1789596767.546249:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 92 00000100:00100000:2.0:1789596767.546261:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:10483:x1876527944873216:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:2.0:1789596767.546281:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596767.546305:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7fd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e73 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546376:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fdf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546392:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546403:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546418:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fe6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546451:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546460:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546718:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7fed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546728:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7fed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546736:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7fed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596767.546746:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789596767.546882:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546891:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fdf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546898:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546904:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427a00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596767.546909:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546916:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fdf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546939:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:2.0:1789596767.546942:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596767.546948:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546955:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d7fdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546969:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546975:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fe6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546981:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546986:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596767.546989:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.546995:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fe6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.547003:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ea8e0eea000) 00010000:00010000:2.0:1789596767.547006:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596767.547008:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fe6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.547014:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d7fe6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.547067:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d7fd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e73 expref: 30 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.547082:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7fed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e73 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.547089:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d1438d00) 00010000:00010000:2.0:1789596767.547092:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789596767.547095:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426c00, rc 0) 00000100:00100000:2.0:1789596767.547160:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef647800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+29:10483:x1876527944873216:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 901us (1166us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789596767.547168:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 92 00000100:00100000:1.0:1789596767.550775:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596767.550905:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944873344 00000100:00100000:0.0:1789596767.550915:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944873344 00000100:00100000:0.0:1789596767.551027:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 93 00000100:00100000:0.0:1789596767.551038:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+29:10483:x1876527944873344:12345-192.168.202.44@tcp:54:lfs.0 00010000:00010000:0.0:1789596767.551131:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7ffb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.551149:0:10902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7fa0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e5e expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.551159:0:10902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7ffb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.551193:0:10902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7fa0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e5e expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.551218:0:10902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7fa0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e5e expref: 29 pid: 5841 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596767.551233:0:10902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef764a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10902:1876527964814720:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789596767.551646:0:10902:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c533a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596767.553901:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596767.553997:0:10902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef764a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10902:1876527964814720:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596767.554020:0:10902:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7ffb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596767.554104:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944873600 00000100:00100000:2.0:1789596767.554112:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944873600 00000100:00100000:2.0:1789596767.554172:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 22 00000100:00100000:2.0:1789596767.554181:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+30:5589:x1876527944873600:12345-192.168.202.44@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789596767.554512:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+31:5589:x1876527944873600:12345-192.168.202.44@tcp:35:ldlm_bl.0 Request processed in 331us (618us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1789596767.554521:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 22 00000100:00100000:3.0:1789596767.556716:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596767.556857:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944873728 00000100:00100000:1.0:1789596767.556866:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944873728 00010000:00010000:1.0:1789596767.556899:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7fa0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e5e expref: 31 pid: 5841 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596767.556926:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 48 00000100:00100000:1.0:1789596767.556934:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef647b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+31:2354:x1876527944873728:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596767.556949:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596767.556957:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7fa0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e5e expref: 31 pid: 5841 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.556970:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7fa0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e5e expref: 31 pid: 5841 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.556990:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d7fa0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e5e expref: 31 pid: 5841 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.557009:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d1438d00) 00010000:00010000:1.0:1789596767.557014:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7ffb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.557023:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.557031:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7ffb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.557078:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596767.557131:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef647b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+30:2354:x1876527944873728:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 197us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596767.557139:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 48 00010000:00010000:2.0:1789596767.557634:0:10902:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.557645:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.557673:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.557688:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7ffb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.557694:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7ffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.557700:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596767.557705:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7ffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.557712:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7ffb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.557723:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d1438d00) 00010000:00010000:2.0:1789596767.557726:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789596767.557730:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7ffb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.557736:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d7ffb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596767.557784:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+29:10483:x1876527944873344:12345-192.168.202.44@tcp:54:lfs.0 Request processed in 6748us (7017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596767.557793:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 93 00000100:00100000:3.0:1789596767.560784:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596767.560964:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944873984 00000100:00100000:2.0:1789596767.560975:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944873984 00000100:00100000:2.0:1789596767.561038:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 23 00000100:00100000:2.0:1789596767.561049:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+29:10483:x1876527944873984:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:2.0:1789596767.561271:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+30:10483:x1876527944873984:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 224us (496us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789596767.561294:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 23 00000100:00100000:3.0:1789596767.642566:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596767.642731:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944874240 00000100:00100000:0.0:1789596767.642741:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944874240 00000100:00100000:0.0:1789596767.642800:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 94 00000100:00100000:0.0:1789596767.642811:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+30:10494:x1876527944874240:12345-192.168.202.44@tcp:101:cat.0 00010000:00010000:0.0:1789596767.642864:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596767.642888:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8002 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.642962:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8009 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.642977:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8009 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.642989:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8009 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643004:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8010 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643011:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8010 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643018:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8010 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643277:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8017 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643287:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643303:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596767.643313:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1789596767.643403:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8009 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643412:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8009 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643418:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8009 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643425:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596767.643430:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8009 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643450:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8009 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643463:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:0.0:1789596767.643466:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596767.643471:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8009 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643486:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8009 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643501:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8010 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643507:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8010 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643520:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8010 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643525:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596767.643528:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8010 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643535:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8010 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643544:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ea8d55e5600) 00010000:00010000:0.0:1789596767.643546:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596767.643548:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8010 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643554:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8010 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643595:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8002 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e7a expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643612:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e7a expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.643620:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d1438d00) 00010000:00010000:0.0:1789596767.643622:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596767.643625:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c1483600, rc 0) 00000100:00100000:0.0:1789596767.643691:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+32:10494:x1876527944874240:12345-192.168.202.44@tcp:101:cat.0 Request processed in 881us (1134us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1789596767.643709:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 94 00000100:00100000:3.0:1789596767.648336:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596767.648451:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944874496 00000100:00100000:2.0:1789596767.648462:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944874496 00000100:00100000:2.0:1789596767.648531:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 24 00000100:00100000:2.0:1789596767.648542:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+32:10494:x1876527944874496:12345-192.168.202.44@tcp:35:cat.0 00000100:00100000:2.0:1789596767.648772:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+33:10494:x1876527944874496:12345-192.168.202.44@tcp:35:cat.0 Request processed in 231us (445us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789596767.648779:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 24 00000100:00100000:3.0:1789596767.665396:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596767.666574:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944874752 00000100:00100000:2.0:1789596767.666586:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944874752 00000100:00100000:2.0:1789596767.666658:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 95 00000100:00100000:2.0:1789596767.666670:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+33:10495:x1876527944874752:12345-192.168.202.44@tcp:36:rm.0 00010000:00010000:2.0:1789596767.666729:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789596767.666757:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8017 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e7a expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.666784:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d7fed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e73 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.666797:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d7fb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e65 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.666808:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8d1438d00) 00010000:00010000:2.0:1789596767.667139:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596767.667162:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8025 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.667190:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8025 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.667200:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8025 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.667227:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d802c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.667234:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d802c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.667241:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d802c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.667491:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8033 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.667500:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8033 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.667508:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8033 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789596767.668123:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1789596767.668133:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352632316041ns, next at 353632313835ns, rc = 0 00010000:00010000:2.0:1789596767.668190:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d803a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.668201:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d803a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.668220:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d803a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.668228:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d803a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.668235:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d803a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.668241:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d803a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.668271:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596767.668290:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8033 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.668297:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8033 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.668304:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8033 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.668310:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427a00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596767.668313:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8033 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.668320:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8033 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.668331:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eea900) 00010000:00010000:2.0:1789596767.668334:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789596767.668343:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8033 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.668350:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8033 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.668368:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8025 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.668375:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8025 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.668381:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8025 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.668386:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596767.668390:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8025 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.668395:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8025 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.668403:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:2.0:1789596767.668406:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596767.668409:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8025 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.668414:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8025 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596767.668424:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cbff885 reply state 00000000b1832334 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d802c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596767.668444:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789596767.668544:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+32:10495:x1876527944874752:12345-192.168.202.44@tcp:36:rm.0 Request processed in 1873us (3157us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789596767.668552:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 95 00010000:00010000:3.0:1789596767.672966:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596767.672981:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d803a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.672999:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:3.0:1789596767.673004:0:7643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d803a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.673014:0:7643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d803a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.673034:0:7643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ea8e0eea900) 00010000:00010000:3.0:1789596767.673037:0:7643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789596767.673042:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d803a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.673049:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d803a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.673074:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596767.673076:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596767.673078:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596767.675009:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d802c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.675025:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d802c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.675034:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d802c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.675040:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596767.675045:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d802c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.675052:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d802c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.675067:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ea8e0eea000) 00010000:00010000:1.0:1789596767.675070:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596767.675074:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d802c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.675079:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d802c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596767.717362:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596767.717537:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944875008 00000100:00100000:0.0:1789596767.717550:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944875008 00000100:00100000:0.0:1789596767.717706:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 96 00000100:00100000:0.0:1789596767.717718:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+31:10501:x1876527944875008:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:0.0:1789596767.717745:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596767.717766:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d8041 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e81 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.717940:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8048 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.717956:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8048 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.717968:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8048 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.717985:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d804f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.717992:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d804f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.718000:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d804f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789596767.718544:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789596767.719116:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8056 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.719137:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.719147:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.719183:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8048 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.719190:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8048 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.719197:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8048 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.719203:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596767.719207:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8048 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.719216:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8048 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.719227:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:0.0:1789596767.719230:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596767.719235:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8048 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.719241:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8048 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789596767.719255:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4ef6d1d reply state 00000000fbada2b2 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d804f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596767.719269:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789596767.719300:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d8041 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e81 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.719316:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e81 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.719323:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8d55e5a00) 00010000:00010000:0.0:1789596767.719326:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596767.719328:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c1482400, rc 0) 00000100:00100000:0.0:1789596767.719398:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+34:10501:x1876527944875008:12345-192.168.202.44@tcp:101:bash.0 Request processed in 1681us (2045us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789596767.719406:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 96 00010000:00010000:0.0:1789596767.722790:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d804f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.722808:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d804f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.722851:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d804f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.722859:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596767.722864:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d804f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.722872:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d804f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.722912:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ea8d55e5600) 00010000:00010000:0.0:1789596767.722915:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596767.722919:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d804f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.722925:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d804f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596767.724510:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596767.724566:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944875136 00000100:00100000:0.0:1789596767.724575:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944875136 00000100:00100000:0.0:1789596767.724660:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 34 00000100:00100000:0.0:1789596767.724673:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2354:x1876527944875136:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:0.0:1789596767.724691:0:9219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596767.724714:0:9219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d8064 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e88 expref: -99 pid: 9219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789596767.724744:0:9219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596767.724763:0:9219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=352s v=(0 0) 00010000:00010000:0.0:1789596767.724767:0:9219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596767.724776:0:9219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d8064 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e88 expref: 8 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.724794:0:9219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d8064 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e88 expref: 8 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.724807:0:9219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c1483600, rc 0) 00000100:00100000:0.0:1789596767.724910:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2354:x1876527944875136:12345-192.168.202.44@tcp:101:bash.0 Request processed in 240us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596767.724929:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 34 00000100:00080000:2.0:1789596767.725075:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789596767.729062:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596767.729369:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944875264 00000100:00100000:0.0:1789596767.729381:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944875264 00000100:00100000:0.0:1789596767.729543:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 35 00000100:00100000:0.0:1789596767.729554:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:10501:x1876527944875264:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:0.0:1789596767.729573:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596767.729604:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ac7da29/0x8973ae90b38d806b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e8f expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.729636:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d8064 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e88 expref: 9 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.729645:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596767.729650:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596767.729655:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac7da29/0x8973ae90b38d806b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e8f expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.729690:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d8064 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e88 expref: 9 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.729704:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d8064 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e88 expref: 9 pid: 9219 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596767.729718:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef764a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1876527964814848:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789596767.729810:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d3548780 going to sleep for 11 seconds 00000100:00100000:0.0:1789596767.734888:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef764a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1876527964814848:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596767.734920:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ac7da29/0x8973ae90b38d806b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e8f expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.734942:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c1483c00, rc 0) 00000100:00100000:0.0:1789596767.735338:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:10501:x1876527944875264:12345-192.168.202.44@tcp:101:bash.0 Request processed in 5783us (6282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596767.735349:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 35 00000100:00100000:3.0:1789596767.738158:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596767.738314:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944875392 00000100:00100000:2.0:1789596767.738327:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944875392 00010000:00010000:2.0:1789596767.738372:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d8064 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e88 expref: 9 pid: 9219 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596767.738420:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 49 00000100:00100000:2.0:1789596767.738431:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c8281c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:2354:x1876527944875392:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596767.738454:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596767.738490:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d8064 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e88 expref: 9 pid: 9219 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.738505:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d8064 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e88 expref: 9 pid: 9219 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.738530:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d8064 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e88 expref: 9 pid: 9219 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.738547:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596767.738552:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596767.738559:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac7da29/0x8973ae90b38d806b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e8f expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.738583:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ac7da29/0x8973ae90b38d806b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e8f expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.738623:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002ac7da29/0x8973ae90b38d806b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e8f expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596767.738638:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d142ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1876527964814976:192.168.202.44@tcp:105: 00000100:00100000:2.0:1789596767.738722:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d353e840 going to sleep for 11 seconds 00000100:00100000:3.0:1789596767.741854:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596767.742363:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d142ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1876527964814976:192.168.202.44@tcp:105: 00010000:00010000:2.0:1789596767.742390:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596767.742449:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c8281c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2354:x1876527944875392:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 4019us (4300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596767.742461:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 49 00000100:00100000:0.0:1789596767.743170:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944875648 00000100:00100000:0.0:1789596767.743179:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944875648 00000100:00100000:0.0:1789596767.743232:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 25 00000100:00100000:0.0:1789596767.743241:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+33:10501:x1876527944875648:12345-192.168.202.44@tcp:35:bash.0 00000100:00100000:0.0:1789596767.743557:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+34:10501:x1876527944875648:12345-192.168.202.44@tcp:35:bash.0 Request processed in 316us (1745us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789596767.743564:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 25 00000100:00100000:3.0:1789596767.884364:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596767.884587:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944875776 00000100:00100000:0.0:1789596767.884599:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944875776 00000100:00100000:0.0:1789596767.884661:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 97 00000100:00100000:0.0:1789596767.884671:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+34:10517:x1876527944875776:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789596767.884697:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596767.884719:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d8072 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e96 expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.884792:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8079 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.884809:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.884879:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596767.884918:0:10902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789596767.884923:0:10902:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789596767.884943:0:10902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8079 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.884972:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d8072 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e96 expref: 36 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.885005:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8079 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e96 expref: 35 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.885014:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:0.0:1789596767.885017:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789596767.885020:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c1483200, rc 0) 00000100:00100000:0.0:1789596767.885078:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+35:10517:x1876527944875776:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 408us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596767.885085:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 97 00000100:00100000:3.0:1789596767.887649:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596767.887746:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944876032 00000100:00100000:2.0:1789596767.887757:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944876032 00000100:00100000:2.0:1789596767.887813:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 98 00000100:00100000:2.0:1789596767.887865:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+35:10517:x1876527944876032:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:2.0:1789596767.887886:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596767.887907:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8080 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344e9d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.888020:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.888036:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.888066:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596767.888080:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789596767.888221:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8080 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e9d expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.888240:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e9d expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.888249:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8d55e5a00) 00010000:00010000:2.0:1789596767.888252:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596767.888255:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427a00, rc 0) 00000100:00100000:2.0:1789596767.888311:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+37:10517:x1876527944876032:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 449us (671us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789596767.888318:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 98 00000100:00100000:3.0:1789596767.891260:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596767.891454:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596767.891553:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944876160 00000100:00100000:1.0:1789596767.891564:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944876160 00000100:00100000:1.0:1789596767.891652:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 6 00000100:00100000:1.0:1789596767.891666:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+37:2354:x1876527944876160:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596767.891680:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596767.891705:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8087 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e9d expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.891722:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8d55e5a00) 00010000:00010000:1.0:1789596767.891728:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596767.891784:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+36:2354:x1876527944876160:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 120us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596767.891791:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 6 00000100:00100000:0.0:1789596767.892286:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944876416 00000100:00100000:0.0:1789596767.892293:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944876416 00000100:00100000:0.0:1789596767.892413:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 99 00000100:00100000:0.0:1789596767.892421:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+36:10517:x1876527944876416:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789596767.892442:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596767.892459:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d8095 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344ea4 expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.892577:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d809c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.892654:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d809c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.892667:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d809c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596767.892680:0:10902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789596767.892811:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d8095 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ea4 expref: 39 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.892861:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d809c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ea4 expref: 38 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.892870:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8d55e5a00) 00010000:00010000:0.0:1789596767.892873:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789596767.892876:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c1483600, rc 0) 00000100:00100000:0.0:1789596767.892926:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+38:10517:x1876527944876416:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 505us (1471us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1789596767.892932:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 99 00000100:00100000:3.0:1789596767.909240:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596767.909558:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944876544 00000100:00100000:2.0:1789596767.909569:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944876544 00000100:00100000:2.0:1789596767.909633:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 36 00000100:00100000:2.0:1789596767.909643:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2352:x1876527944876544:12345-192.168.202.44@tcp:1:lfs.0 00010000:00010000:2.0:1789596767.909688:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fbb916d/0x8973ae90b38d80aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.909709:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ac7da29/0x8973ae90b38d806b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e8f expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.909718:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596767.909739:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789596767.909744:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fbb916d/0x8973ae90b38d80aa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.909785:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ac7da29/0x8973ae90b38d806b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e8f expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.909800:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ac7da29/0x8973ae90b38d806b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e8f expref: 8 pid: 6693 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596767.909857:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d142ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1876527964815104:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789596767.909957:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d353e900 going to sleep for 11 seconds 00000100:00100000:2.0:1789596767.913683:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d142ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1876527964815104:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789596767.913718:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001fbb916d/0x8973ae90b38d80aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596767.915214:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596767.915606:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944876672 00000100:00100000:2.0:1789596767.915616:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944876672 00002000:00100000:2.0:1789596767.915662:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ea8f64e9180 x1876527944876672/t0(0) o4->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:648/0 lens 504/0 e 0 to 0 dl 1789596778 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789596767.915674:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8f64e9180 with x1876527944876672 ext(0->8) 00010000:00010000:2.0:1789596767.915683:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ac7da29/0x8973ae90b38d806b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e8f expref: 9 pid: 6693 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.915700:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ac7da29/0x8973ae90b38d806b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e8f expref: 9 pid: 6693 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789596767.915726:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ea8f64e9180 00000100:00100000:2.0:1789596767.915765:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1 00000100:00100000:2.0:1789596767.915775:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:2354:x1876527944876672:12345-192.168.202.44@tcp:4:lfs.0 00000100:00100000:2.0:1789596767.916654:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+11:2354:x1876527944876672:12345-192.168.202.44@tcp:4:lfs.0 Request processed in 875us (1447us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789596767.916664:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1 00002000:00100000:2.0:1789596767.916673:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ea8f64e9180 x1876527944876672/t4294967302(0) o4->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:648/0 lens 504/448 e 0 to 0 dl 1789596778 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789596767.916682:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8f64e9180 with x1876527944876672 ext(0->8) 00010000:00010000:2.0:1789596767.916689:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ac7da29/0x8973ae90b38d806b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e8f expref: 11 pid: 6693 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.916705:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ac7da29/0x8973ae90b38d806b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e8f expref: 11 pid: 6693 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789596767.916713:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ea8f64e9180 00000100:00100000:3.0:1789596767.923729:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596767.923895:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944876800 00000100:00100000:0.0:1789596767.923906:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944876800 00010000:00010000:0.0:1789596767.923949:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ac7da29/0x8973ae90b38d806b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e8f expref: 11 pid: 6693 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596767.924004:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 50 00000100:00100000:0.0:1789596767.924026:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+11:2351:x1876527944876800:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596767.924052:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789596767.924071:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789596767.924074:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789596767 00002000:00010000:0.0:1789596767.924076:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789596767 00002000:00010000:0.0:1789596767.924079:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789596767 00010000:00010000:0.0:1789596767.924085:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ac7da29/0x8973ae90b38d806b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e8f expref: 11 pid: 6693 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.924099:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ac7da29/0x8973ae90b38d806b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e8f expref: 11 pid: 6693 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.924121:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ac7da29/0x8973ae90b38d806b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e8f expref: 11 pid: 6693 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.924139:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789596767.924144:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789596767.924149:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001fbb916d/0x8973ae90b38d80aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.924159:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fbb916d/0x8973ae90b38d80aa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.924194:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596767.924260:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+10:2351:x1876527944876800:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 234us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596767.924267:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 50 00010000:00010000:3.0:1789596767.925791:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001fbb916d/0x8973ae90b38d80aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.925808:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fbb916d/0x8973ae90b38d80aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.925871:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fbb916d/0x8973ae90b38d80aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.925879:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fbb916d/0x8973ae90b38d80aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.925888:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fbb916d/0x8973ae90b38d80aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.925895:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427e00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:3.0:1789596767.925900:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fbb916d/0x8973ae90b38d80aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.925907:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fbb916d/0x8973ae90b38d80aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.925938:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fbb916d/0x8973ae90b38d80aa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596767.925946:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fbb916d/0x8973ae90b38d80aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596767.926153:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:2352:x1876527944876544:12345-192.168.202.44@tcp:1:lfs.0 Request processed in 16508us (16920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596767.926162:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 36 00000100:00100000:1.0:1789596767.942162:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596767.942337:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944877056 00000100:00100000:0.0:1789596767.942347:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944877056 00000100:00100000:0.0:1789596767.942453:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 26 00000100:00100000:0.0:1789596767.942465:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3550450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+38:10517:x1876527944877056:12345-192.168.202.44@tcp:35:lfs.0 00000004:00010000:0.0:1789596767.942537:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d809c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ea4 expref: 38 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789596767.943036:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1789596767.943087:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1789596767.943390:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1789596767.943446:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.943462:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8056 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e81 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.943482:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80b1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.943518:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e81 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596767.943532:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8056 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e81 expref: 42 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596767.943547:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef764a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1876527964815232:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789596767.943672:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c11ca6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596767.949060:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596767.949651:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef764a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1876527964815232:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596767.949695:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596767.949781:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944877184 00000100:00100000:2.0:1789596767.949789:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944877184 00010000:00010000:2.0:1789596767.949866:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8056 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e81 expref: 43 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596767.949899:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 51 00000100:00100000:2.0:1789596767.949908:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+43:2353:x1876527944877184:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596767.949931:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596767.949938:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8056 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e81 expref: 43 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.949952:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e81 expref: 43 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.949973:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8056 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e81 expref: 43 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.950002:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8d55e5a00) 00010000:00010000:2.0:1789596767.950007:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.950017:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.950024:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80b1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.950056:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789596767.950176:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.950184:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789596767.950314:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1789596767.950523:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1789596767.950631:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef649c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1876527964815360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789596767.950683:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596767.950714:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596767.950751:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964815360 00000100:00100000:1.0:1789596767.950756:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964815360 00000100:00100000:1.0:1789596767.950785:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789596767.950791:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5844:x1876527964815360:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789596767.950910:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5844:x1876527964815360:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 118us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596767.950916:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789596767.950958:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef649c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1876527964815360:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789596767.951400:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1789596767.951460:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef649c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1876527964815488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789596767.951507:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596767.951536:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964815488 00000100:00100000:1.0:1789596767.951541:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964815488 00000100:00100000:1.0:1789596767.951566:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789596767.951573:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5844:x1876527964815488:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789596767.951708:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5844:x1876527964815488:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 134us (200us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789596767.951714:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789596767.951734:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652e540 going to sleep for 11 seconds 00000100:00100000:1.0:1789596767.951754:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef649c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1876527964815488:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789596767.951787:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1789596767.951838:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.951847:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.951855:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.951861:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596767.951872:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.951881:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.951895:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8d55e5a00) 00010000:00010000:1.0:1789596767.951898:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789596767.951902:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596767.951909:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789596767.952075:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789596767.952171:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1789596767.952181:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352916364453ns, next at 353916362536ns, rc = 0 00000001:00080000:1.0:1789596767.952187:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1789596767.952217:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8d55e5a00) 00010000:00010000:1.0:1789596767.952220:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789596767.952227:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d809c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ea4 expref: 47 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596767.952373:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+46:2353:x1876527944877184:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 2463us (3322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596767.952383:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 51 00000100:00100000:1.0:1789596767.954263:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3550450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+45:10517:x1876527944877056:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 11730us (12040us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1789596767.954277:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 26 00000020:00080000:1.0:1789596767.954285:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789596767.963161:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596767.963374:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944877312 00000100:00100000:2.0:1789596767.963385:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944877312 00000100:00100000:2.0:1789596767.963453:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 100 00000100:00100000:2.0:1789596767.963465:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+45:10517:x1876527944877312:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:2.0:1789596767.963515:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596767.963539:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d80b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344eab expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.963600:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d80b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344eab expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.963615:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d80b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344eab expref: 46 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596767.963635:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:2.0:1789596767.963638:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596767.963642:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426400, rc 0) 00000100:00100000:2.0:1789596767.963859:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+46:10517:x1876527944877312:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 396us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596767.963867:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 100 00000100:00100000:2.0:1789596767.970860:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596767.970954:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944877568 00000100:00100000:1.0:1789596767.970965:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944877568 00000100:00100000:1.0:1789596767.971033:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 27 00000100:00100000:1.0:1789596767.971042:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d142ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+46:10517:x1876527944877568:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:1.0:1789596767.971441:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d142ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+47:10517:x1876527944877568:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 391us (581us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1789596767.971449:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 27 00000100:00100000:1.0:1789596768.134683:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596768.134790:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944877696 00000100:00100000:0.0:1789596768.134801:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944877696 00000100:00100000:0.0:1789596768.134904:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 101 00000100:00100000:0.0:1789596768.134917:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+47:10527:x1876527944877696:12345-192.168.202.44@tcp:34:lfs.0 00010000:00010000:0.0:1789596768.135017:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d80bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135035:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d80bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135049:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d80bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135065:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135072:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135078:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135165:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135174:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135182:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789596768.135239:0:10902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135251:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d80bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135258:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d80bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135265:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d80bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135271:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1482600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596768.135275:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d80bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135282:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d80bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135294:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:0.0:1789596768.135297:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596768.135302:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d80bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135307:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d80bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135321:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135327:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135338:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135343:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596768.135346:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135352:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135360:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ea8d55e5600) 00010000:00010000:0.0:1789596768.135363:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596768.135366:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135371:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135387:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135394:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135399:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135404:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596768.135407:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135424:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135665:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:0.0:1789596768.135668:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596768.135673:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.135679:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596768.135769:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+47:10527:x1876527944877696:12345-192.168.202.44@tcp:34:lfs.0 Request processed in 854us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596768.135777:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 101 00000100:00080000:2.0:1789596768.135936:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789596768.155463:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596768.174556:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596768.174683:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944877952 00000100:00100000:0.0:1789596768.174693:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944877952 00000100:00100000:0.0:1789596768.174752:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 102 00000100:00100000:0.0:1789596768.174762:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+47:10530:x1876527944877952:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789596768.174784:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596768.174805:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344eb2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.174953:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d80db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.174969:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d80db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.174992:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d80db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175017:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d80e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175042:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d80e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175049:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d80e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175166:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d80e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175175:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d80e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175183:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d80e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596768.175192:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789596768.175300:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d80db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175306:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d80db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175310:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d80db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175314:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596768.175317:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d80db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175322:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d80db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175338:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:2.0:1789596768.175340:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596768.175344:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d80db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175348:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d80db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175358:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d80e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175361:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d80e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175365:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d80e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175368:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596768.175370:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d80e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175373:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d80e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175377:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ea8e0eea700) 00010000:00010000:2.0:1789596768.175378:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596768.175380:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d80e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175383:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d80e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175419:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d80d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344eb2 expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175432:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d80e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344eb2 expref: 49 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.175439:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:2.0:1789596768.175441:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596768.175444:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426000, rc 0) 00000100:00100000:2.0:1789596768.175604:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+49:10530:x1876527944877952:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 842us (1055us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789596768.175612:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 102 00000100:00100000:3.0:1789596768.184694:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596768.184804:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944878080 00000100:00100000:0.0:1789596768.184855:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944878080 00000100:00100000:0.0:1789596768.184908:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 103 00000100:00100000:0.0:1789596768.184918:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+49:10530:x1876527944878080:12345-192.168.202.44@tcp:54:lfs.0 00010000:00010000:0.0:1789596768.184990:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.185021:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.185034:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.185059:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.185066:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.185073:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.185079:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596768.185083:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.185091:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.185101:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:0.0:1789596768.185104:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789596768.185108:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.185114:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d80f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596768.185182:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+49:10530:x1876527944878080:12345-192.168.202.44@tcp:54:lfs.0 Request processed in 266us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596768.185195:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 103 00000100:00100000:3.0:1789596768.187356:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596768.187834:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944878336 00000100:00100000:0.0:1789596768.187845:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944878336 00000100:00100000:0.0:1789596768.187913:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 28 00000100:00100000:0.0:1789596768.187924:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+49:10530:x1876527944878336:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:0.0:1789596768.188191:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+50:10530:x1876527944878336:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 267us (843us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1789596768.188210:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 28 00000100:00100000:3.0:1789596768.292551:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596768.292765:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944878592 00000100:00100000:2.0:1789596768.292777:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944878592 00000100:00100000:2.0:1789596768.292844:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 104 00000100:00100000:2.0:1789596768.292853:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+50:10540:x1876527944878592:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:2.0:1789596768.292879:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596768.292882:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789596768.292906:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8079 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e96 expref: 50 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.292928:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:2.0:1789596768.292932:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596768.292944:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d80fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344eb9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.293060:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8105 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.293073:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.293084:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596768.293093:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789596768.293198:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d80fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344eb9 expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.293286:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8105 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344eb9 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.293294:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:2.0:1789596768.293297:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596768.293300:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427000, rc 0) 00000100:00100000:2.0:1789596768.293410:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+51:10540:x1876527944878592:12345-192.168.202.44@tcp:101:bash.0 Request processed in 558us (871us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1789596768.293417:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 104 00000100:00100000:3.0:1789596768.308351:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596768.308478:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944878848 00000100:00100000:0.0:1789596768.308490:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944878848 00000100:00100000:0.0:1789596768.308560:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 105 00000100:00100000:0.0:1789596768.308570:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+51:10540:x1876527944878848:12345-192.168.202.44@tcp:36:bash.0 00010000:00010000:0.0:1789596768.308645:0:10902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789596768.308673:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8105 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344eb9 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.308696:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d80e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344eb2 expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.308706:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:0.0:1789596768.308711:0:10902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596768.308973:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d8113 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.308986:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d8113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.309438:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d8113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789596768.309511:0:10902:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1789596768.309543:0:10902:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003dddb0f7 reply state 00000000fa0081e3 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d8113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596768.309552:0:10902:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789596768.309661:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+52:10540:x1876527944878848:12345-192.168.202.44@tcp:36:bash.0 Request processed in 1091us (1322us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1789596768.309669:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 105 00000020:00080000:0.0:1789596768.309675:0:10902:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789596768.315106:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00010000:00010000:1.0:1789596768.315168:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d8113 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.315181:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d8113 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.315189:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d8113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.315195:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1482600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596768.315200:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d8113 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.315207:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d8113 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.315223:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:1.0:1789596768.315226:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596768.315231:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d8113 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.315237:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d8113 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596768.315296:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944878976 00000100:00100000:2.0:1789596768.315306:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944878976 00000100:00100000:2.0:1789596768.315363:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 106 00000100:00100000:2.0:1789596768.315372:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+51:10540:x1876527944878976:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:2.0:1789596768.315394:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596768.315422:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d811a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344ec0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.315512:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d8121 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.315524:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d8121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.315534:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d8121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596768.315567:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789596768.315571:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789596768.315594:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d8121 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.315621:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d811a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ec0 expref: 53 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.315635:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d8121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ec0 expref: 52 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.315643:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:2.0:1789596768.315646:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596768.315648:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426c00, rc 0) 00000100:00100000:2.0:1789596768.315719:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+52:10540:x1876527944878976:12345-192.168.202.44@tcp:101:bash.0 Request processed in 347us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596768.315725:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 106 00000100:00100000:3.0:1789596768.318727:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596768.318897:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944879232 00000100:00100000:0.0:1789596768.318908:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944879232 00000100:00100000:0.0:1789596768.318961:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 29 00000100:00100000:0.0:1789596768.318971:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff53a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+52:10540:x1876527944879232:12345-192.168.202.44@tcp:35:bash.0 00000100:00100000:0.0:1789596768.319224:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff53a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+53:10540:x1876527944879232:12345-192.168.202.44@tcp:35:bash.0 Request processed in 253us (505us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1789596768.319232:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 29 00000100:00100000:3.0:1789596768.385995:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596768.386107:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944879360 00000100:00100000:1.0:1789596768.386118:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944879360 00000100:00100000:1.0:1789596768.386184:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 107 00000100:00100000:1.0:1789596768.386221:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff53aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+53:10546:x1876527944879360:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:1.0:1789596768.386248:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596768.386269:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d8128 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344ec7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.386334:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d812f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.386349:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d812f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.386361:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d812f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596768.386393:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789596768.386396:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789596768.386412:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d812f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.386447:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d8128 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ec7 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.386476:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d812f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ec7 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.386485:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:1.0:1789596768.386488:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789596768.386491:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a33c00, rc 0) 00000100:00100000:1.0:1789596768.386551:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff53aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+54:10546:x1876527944879360:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 334us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596768.386565:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 107 00000100:00100000:3.0:1789596768.388803:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596768.389002:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944879488 00000100:00100000:2.0:1789596768.389023:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944879488 00000100:00100000:2.0:1789596768.389079:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 108 00000100:00100000:2.0:1789596768.389089:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+54:10546:x1876527944879488:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:2.0:1789596768.389108:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596768.389127:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8136 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344ece expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389186:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d813d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389200:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d813d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389221:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d813d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389238:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8144 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389245:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389252:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389341:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d814b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389350:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d814b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389357:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d814b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596768.389399:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789596768.389403:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789596768.389422:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d814b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389447:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d814b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389454:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d813d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389460:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d813d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389790:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d813d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389797:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596768.389801:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d813d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389808:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d813d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389843:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:2.0:1789596768.389846:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596768.389850:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d813d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389857:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d813d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389879:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389885:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8144 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389891:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8144 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389896:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427a00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596768.389899:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8144 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389904:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8144 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389911:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ea8e0eea700) 00010000:00010000:2.0:1789596768.389914:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596768.389916:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8144 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389922:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d8144 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389950:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8136 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ece expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389961:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d814b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ece expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.389976:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:2.0:1789596768.389979:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596768.390079:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426600, rc 0) 00000100:00100000:2.0:1789596768.390141:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff539c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+55:10546:x1876527944879488:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 1053us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596768.390148:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 108 00000100:00100000:3.0:1789596768.395305:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596768.395729:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944879744 00000100:00100000:1.0:1789596768.395740:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944879744 00000100:00100000:1.0:1789596768.395958:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 109 00000100:00100000:1.0:1789596768.395968:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+55:10546:x1876527944879744:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:1.0:1789596768.395997:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596768.396020:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d8152 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344ed5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.396115:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.396129:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d8121 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ec0 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.396137:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d814b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ece expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.396144:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.396176:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d814b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ece expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.396190:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d814b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ece expref: 56 pid: 5841 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596768.396332:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef649180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964815616:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596768.396581:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d8121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ec0 expref: 56 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.396602:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d8121 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ec0 expref: 56 pid: 5841 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596768.396612:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef648380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964815744:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789596768.396637:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596768.397143:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596768.397856:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944879872 00000100:00100000:1.0:1789596768.397866:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944879872 00010000:00010000:1.0:1789596768.397897:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d814b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ece expref: 57 pid: 5841 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596768.397928:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 52 00000100:00100000:1.0:1789596768.397936:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff538000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+57:2353:x1876527944879872:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596768.397946:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596768.397952:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d814b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ece expref: 57 pid: 5841 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.397964:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d814b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ece expref: 57 pid: 5841 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.397993:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:1.0:1789596768.397999:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.398007:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.398025:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596768.398064:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff538000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+57:2353:x1876527944879872:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 128us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596768.398071:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 52 00010000:00010000:1.0:1789596768.401054:0:5843:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.44@tcp) returned -22 from blocking AST (req@00000000b71c239f x1876527964815616) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d814b lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ece expref: 56 pid: 5841 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.401079:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d814b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ece expref: 56 pid: 5841 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596768.401099:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef649180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964815616:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789596768.401115:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef648380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964815744:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596768.401138:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:1.0:1789596768.401144:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.401153:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.401162:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596768.402895:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596768.402973:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944880000 00000100:00100000:1.0:1789596768.402992:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944880000 00010000:00010000:1.0:1789596768.403031:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d8121 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ec0 expref: 56 pid: 5841 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596768.403080:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 53 00000100:00100000:1.0:1789596768.403089:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d142bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+56:2354:x1876527944880000:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596768.403104:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596768.403111:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d8121 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ec0 expref: 56 pid: 5841 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.403124:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d8121 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ec0 expref: 56 pid: 5841 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.403144:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d8121 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ec0 expref: 56 pid: 5841 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.403161:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:1.0:1789596768.403167:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.403175:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.403183:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.403220:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596768.403272:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d142bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+55:2354:x1876527944880000:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 184us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596768.403280:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 53 00010000:00010000:2.0:1789596768.403403:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.403412:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596768.403430:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789596768.403609:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d8152 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ed5 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.403626:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ed5 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596768.403633:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:2.0:1789596768.403635:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789596768.403638:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a33600, rc 0) 00000100:00100000:2.0:1789596768.403665:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff539500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+55:10546:x1876527944879744:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 7699us (8370us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789596768.403672:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 109 00000100:00100000:3.0:1789596768.411520:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596768.411665:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944880256 00000100:00100000:1.0:1789596768.411691:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944880256 00000100:00100000:1.0:1789596768.411753:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 7 00000100:00100000:1.0:1789596768.411761:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff53b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+55:10546:x1876527944880256:12345-192.168.202.44@tcp:103:lfs.0 00010000:00010000:1.0:1789596768.411777:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596768.411802:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d80b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344eab expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596768.411857:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:1.0:1789596768.411862:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596768.411918:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff53b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+54:10546:x1876527944880256:12345-192.168.202.44@tcp:103:lfs.0 Request processed in 157us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596768.411925:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 7 00000100:00100000:3.0:1789596768.416373:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596768.416498:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944880384 00000100:00100000:0.0:1789596768.416509:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944880384 00000100:00100000:0.0:1789596768.416571:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 110 00000100:00100000:0.0:1789596768.416582:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+54:10546:x1876527944880384:12345-192.168.202.44@tcp:58:lfs.0 00010000:00010000:0.0:1789596768.416673:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8167 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.416703:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8167 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.416715:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8167 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789596768.416935:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789596768.417338:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+54:10546:x1876527944880384:12345-192.168.202.44@tcp:58:lfs.0 Request processed in 756us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596768.417347:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 110 00000100:00100000:3.0:1789596768.425937:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596768.432226:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944880512 00000100:00100000:0.0:1789596768.432243:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944880512 00000100:00100000:0.0:1789596768.432320:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 111 00000100:00100000:0.0:1789596768.432332:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+54:10546:x1876527944880512:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789596768.432353:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596768.432373:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d816e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344edc expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.432429:0:10902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8167 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.432449:0:10902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d816e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344edc expref: 55 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.432478:0:10902:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8167 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.432492:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d816e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344edc expref: 55 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.432520:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:0.0:1789596768.432524:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789596768.432528:0:10902:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d816e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344edc expref: 55 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.432536:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c1482600, rc 0) 00000100:00100000:0.0:1789596768.432608:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff538a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+55:10546:x1876527944880512:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 278us (6681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596768.432616:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 111 00000040:00080000:3.0:1789596768.925906:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789596768.925916:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789596768.925993:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789596768.926000:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789596768.926124:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff539880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876527964815872:192.168.202.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789596768.926228:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff4b0480 going to sleep for 11 seconds 00000100:00100000:3.0:1789596768.930261:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff539880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876527964815872:192.168.202.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789596768.932412:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596768.932807:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944880640 00000100:00100000:0.0:1789596768.932844:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944880640 00000100:00100000:0.0:1789596768.932909:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 112 00000100:00100000:0.0:1789596768.932920:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+55:10548:x1876527944880640:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789596768.932954:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789596768.933066:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff539880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+55:10548:x1876527944880640:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 Request processed in 148us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596768.933075:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 112 00000100:00100000:2.0:1789596768.943052:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596768.943243:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944880768 00000100:00100000:0.0:1789596768.943254:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944880768 00000100:00100000:0.0:1789596768.943321:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 113 00000100:00100000:0.0:1789596768.943331:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d142a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+55:10548:x1876527944880768:12345-192.168.202.44@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789596768.943407:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8175 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943441:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8175 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943469:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8175 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943487:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d817c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943495:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d817c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943504:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d817c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943528:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8183 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943537:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943542:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596768.943579:0:10902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789596768.943583:0:10902:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789596768.943596:0:10902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943605:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8175 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943611:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8175 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943627:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8175 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943633:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596768.943636:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8175 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943644:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8175 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943656:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ea8d55e5800) 00010000:00010000:0.0:1789596768.943659:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596768.943664:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8175 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943670:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d8175 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943686:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d817c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943692:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d817c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943697:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d817c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943701:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596768.943704:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d817c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943720:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d817c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943728:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9ea8d55e5600) 00010000:00010000:0.0:1789596768.943731:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596768.943734:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d817c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943740:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d817c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943753:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943759:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8183 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943763:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8183 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943768:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596768.943771:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8183 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943776:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8183 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943782:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:0.0:1789596768.943785:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596768.943787:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8183 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.943801:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8183 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596768.943935:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d142a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+55:10548:x1876527944880768:12345-192.168.202.44@tcp:34:lhsmtool_posix.0 Request processed in 605us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596768.943953:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 113 00000100:00100000:3.0:1789596768.962457:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596768.962668:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944881024 00000100:00100000:0.0:1789596768.962678:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944881024 00000100:00100000:0.0:1789596768.962738:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 114 00000100:00100000:0.0:1789596768.962748:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+55:10548:x1876527944881024:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789596768.962769:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596768.962790:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d818a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344ee3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.962935:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8191 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.962950:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.962963:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596768.962973:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789596768.963068:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8191 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.963076:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8191 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.963103:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8191 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.963109:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596768.963114:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8191 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.963121:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8191 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.963132:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:0.0:1789596768.963136:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789596768.963140:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8191 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.963146:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8191 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.963187:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d818a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ee3 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.963210:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ea8d55e5800) 00010000:00010000:0.0:1789596768.963212:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789596768.963217:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d818a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ee3 expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.963226:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c1483600, rc 0) 00000100:00100000:0.0:1789596768.963297:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff538700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+56:10548:x1876527944881024:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 551us (850us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1789596768.963313:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 114 00000100:00100000:1.0:1789596768.973642:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596768.973893:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944881152 00000100:00100000:0.0:1789596768.973903:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944881152 00000100:00100000:0.0:1789596768.973974:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 115 00000100:00100000:0.0:1789596768.973992:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+56:10548:x1876527944881152:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789596768.974049:0:10902:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789596768.974159:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+56:10548:x1876527944881152:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 Request processed in 168us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596768.974167:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 115 00000100:00100000:3.0:1789596768.998728:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596768.999687:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944881408 00000100:00100000:0.0:1789596768.999700:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944881408 00000100:00100000:0.0:1789596768.999764:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 116 00000100:00100000:0.0:1789596768.999774:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+56:10548:x1876527944881408:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789596768.999796:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596768.999799:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789596768.999858:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d812f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ec7 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596768.999880:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:0.0:1789596768.999885:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596768.999900:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d819f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344eea expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789596769.000280:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1789596769.000706:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d81a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.000731:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d81a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.000742:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d81a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.000790:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d819f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344eea expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.000807:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d81a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344eea expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.000855:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ea8d55e5600) 00010000:00010000:0.0:1789596769.000858:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596769.000861:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c1483c00, rc 0) 00000100:00100000:0.0:1789596769.000911:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff538e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+57:10548:x1876527944881408:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 1138us (2194us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789596769.000918:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 116 00000100:00100000:3.0:1789596769.012619:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596769.012752:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944881664 00000100:00100000:0.0:1789596769.012763:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944881664 00000100:00100000:0.0:1789596769.012851:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 117 00000100:00100000:0.0:1789596769.012861:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+57:10548:x1876527944881664:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789596769.012961:0:10902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596769.012996:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d81a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344eea expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013016:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ea8d55e5600) 00010000:00010000:0.0:1789596769.013034:0:10902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596769.013056:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d81b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013071:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d81b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013082:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d81b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013096:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7ddf96cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013103:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ddf96cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013110:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ddf96cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013178:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d81b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013185:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d81b4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013192:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d81b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013199:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596769.013203:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d81b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013211:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d81b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013227:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:0.0:1789596769.013229:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596769.013234:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d81b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013239:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d81b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013250:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ddf96cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013256:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ddf96cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013261:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ddf96cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013266:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596769.013269:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ddf96cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013274:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ddf96cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013280:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7ddf96cd (ffff9ea8d55e5100) 00010000:00010000:0.0:1789596769.013282:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596769.013284:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7ddf96cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.013301:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7ddf96cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596769.013394:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff53b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+56:10548:x1876527944881664:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 Request processed in 534us (784us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789596769.013402:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 117 00000100:00100000:1.0:1789596769.016800:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596769.016903:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944881792 00000100:00100000:0.0:1789596769.016914:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944881792 00000100:00100000:2.0:1789596769.017141:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 118 00000100:00100000:2.0:1789596769.017154:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+56:10548:x1876527944881792:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596769.017175:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596769.017199:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d81c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344ef1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.017234:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d81c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.017248:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d81c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.017261:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d81c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.017370:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d81c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ef1 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.017387:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d81c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ef1 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.017395:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ea8e0eea700) 00010000:00010000:2.0:1789596769.017398:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789596769.017401:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427a00, rc 0) 00000100:00100000:2.0:1789596769.017472:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+57:10548:x1876527944881792:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 322us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596769.017479:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 118 00000100:00100000:3.0:1789596769.028623:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596769.028730:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944882048 00000100:00100000:0.0:1789596769.028741:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944882048 00000100:00100000:0.0:1789596769.028805:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 119 00000100:00100000:0.0:1789596769.028852:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+57:10548:x1876527944882048:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789596769.028937:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.028955:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.028967:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789596769.029233:0:10902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1789596769.029242:0:10902:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 353993425494ns, next at 354993422864ns, rc = 0 00000004:00010000:0.0:1789596769.029340:0:10902:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9149d85 reply state 00000000e2647b8b transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596769.029350:0:10902:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789596769.029443:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff539f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+59:10548:x1876527944882048:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 Request processed in 618us (817us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1789596769.029450:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 119 00010000:00010000:0.0:1789596769.033098:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.033127:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.033135:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.033141:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596769.033145:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.033153:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.033169:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ea8e0eea700) 00010000:00010000:0.0:1789596769.033172:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789596769.033177:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.033184:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d81d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596769.033630:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596769.034631:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944882176 00000100:00100000:2.0:1789596769.034644:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944882176 00000100:00100000:2.0:1789596769.034746:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 120 00000100:00100000:2.0:1789596769.034757:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff53b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+58:10548:x1876527944882176:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596769.034782:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596769.034803:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d81d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344ef8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.034890:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d81d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ef8 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.034906:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d81d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ef8 expref: 59 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.034925:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ea8e0eea700) 00010000:00010000:2.0:1789596769.034929:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596769.034933:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426800, rc 0) 00000100:00100000:2.0:1789596769.034995:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff53b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+59:10548:x1876527944882176:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 241us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596769.035003:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 120 00000100:00100000:1.0:1789596769.037738:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596769.037839:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944882304 00000100:00100000:3.0:1789596769.037848:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944882304 00000100:00100000:3.0:1789596769.037909:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 37 00000100:00100000:3.0:1789596769.037918:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2354:x1876527944882304:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789596769.038198:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa436d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:2354:x1876527944882304:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 Request processed in 280us (472us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789596769.038206:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 37 00000100:00080000:1.0:1789596769.038398:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596769.044606:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596769.044859:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944882560 00000100:00100000:1.0:1789596769.044870:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944882560 00000100:00100000:1.0:1789596769.044929:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 30 00000100:00100000:1.0:1789596769.044940:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+59:10548:x1876527944882560:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789596769.045168:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+60:10548:x1876527944882560:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 Request processed in 229us (571us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789596769.045175:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 30 00000100:00100000:3.0:1789596769.046770:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596769.046877:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944882816 00000100:00100000:0.0:1789596769.046886:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944882816 00000100:00100000:0.0:1789596769.046930:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 121 00000100:00100000:0.0:1789596769.046939:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff53ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+60:10548:x1876527944882816:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789596769.047035:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff53ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+60:10548:x1876527944882816:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 Request processed in 96us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596769.047042:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 121 00000100:00100000:1.0:1789596769.054633:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596769.055084:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944882944 00000100:00100000:2.0:1789596769.055095:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944882944 00000100:00100000:2.0:1789596769.055153:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 122 00000100:00100000:2.0:1789596769.055164:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+60:10548:x1876527944882944:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596769.055185:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596769.055205:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d81de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344eff expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.055272:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d81e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.055298:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d81e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.055312:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d81e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596769.055349:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789596769.055368:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d81e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.055394:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d81de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344eff expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.055412:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d81e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344eff expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.055420:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ea8e0eea700) 00010000:00010000:2.0:1789596769.055424:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789596769.055427:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427800, rc 0) 00000100:00100000:2.0:1789596769.055497:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa437b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+61:10548:x1876527944882944:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 335us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596769.055504:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 122 00000100:00100000:3.0:1789596769.060930:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596769.060986:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944883072 00000100:00100000:0.0:1789596769.061020:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944883072 00000100:00100000:0.0:1789596769.061089:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 38 00000100:00100000:0.0:1789596769.061099:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff53bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:2354:x1876527944883072:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789596769.061116:0:9219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596769.061136:0:9219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000476cb42e/0x8973ae90b38d81ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f06 expref: -99 pid: 9219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789596769.061162:0:9219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab1461, blocks: 0x1 00010000:00010000:0.0:1789596769.061181:0:9219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=354s v=(0 0) 00010000:00010000:0.0:1789596769.061187:0:9219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596769.061196:0:9219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000476cb42e/0x8973ae90b38d81ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f06 expref: 10 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.061215:0:9219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000476cb42e/0x8973ae90b38d81ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f06 expref: 10 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.061228:0:9219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c1483200, rc 0) 00000100:00100000:0.0:1789596769.061285:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff53bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+10:2354:x1876527944883072:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 188us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596769.061292:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 38 00000100:00100000:3.0:1789596769.063795:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596769.063925:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944883328 00000100:00100000:1.0:1789596769.063936:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944883328 00000100:00100000:1.0:1789596769.063993:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 123 00000100:00100000:1.0:1789596769.064017:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+61:10548:x1876527944883328:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789596769.064123:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff53a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+61:10548:x1876527944883328:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 Request processed in 108us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596769.064131:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 123 00000100:00100000:1.0:1789596769.067065:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596769.067180:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944883456 00000100:00100000:3.0:1789596769.067190:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944883456 00000100:00100000:3.0:1789596769.067248:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 39 00000100:00100000:3.0:1789596769.067257:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+10:10548:x1876527944883456:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596769.067289:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596769.067307:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d81f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f0d expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.067336:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000476cb42e/0x8973ae90b38d81ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f06 expref: 11 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.067346:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596769.067350:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596769.067356:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d81f3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f0d expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.067399:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000476cb42e/0x8973ae90b38d81ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f06 expref: 11 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.067411:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000476cb42e/0x8973ae90b38d81ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f06 expref: 11 pid: 9219 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596769.067423:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5049f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876527964816000:192.168.202.44@tcp:104: 00000100:00100000:3.0:1789596769.067555:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff4b0480 going to sleep for 11 seconds 00000100:00100000:1.0:1789596769.069881:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5049f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876527964816000:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596769.069919:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d81f3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f0d expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.069941:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89200, rc 0) 00000100:00100000:1.0:1789596769.070002:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa436680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+11:10548:x1876527944883456:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 2746us (2947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596769.070011:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 39 00000100:00100000:1.0:1789596769.079114:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596769.079360:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944883584 00000100:00100000:2.0:1789596769.079370:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944883584 00010000:00010000:2.0:1789596769.079412:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000476cb42e/0x8973ae90b38d81ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f06 expref: 11 pid: 9219 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596769.079479:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 54 00000100:00100000:2.0:1789596769.079503:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c8283450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+11:2354:x1876527944883584:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596769.079519:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596769.079543:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000476cb42e/0x8973ae90b38d81ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f06 expref: 11 pid: 9219 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.079558:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000476cb42e/0x8973ae90b38d81ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f06 expref: 11 pid: 9219 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.079581:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000476cb42e/0x8973ae90b38d81ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f06 expref: 11 pid: 9219 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.079614:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596769.079619:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596769.079628:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d81f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f0d expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.079638:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d81f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f0d expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.079677:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d81f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f0d expref: 10 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596769.079692:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d142a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1876527964816128:192.168.202.44@tcp:105: 00000100:00100000:2.0:1789596769.079779:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d353e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596769.093703:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596769.093852:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944883712 00000100:00100000:0.0:1789596769.093863:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944883712 00002000:00100000:0.0:1789596769.093913:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ea8d142aa00 x1876527944883712/t0(0) o4->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:650/0 lens 504/0 e 0 to 0 dl 1789596780 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789596769.093925:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8d142aa00 with x1876527944883712 ext(0->12) 00002000:00010000:0.0:1789596769.093931:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ea8d142aa00 00000100:00100000:0.0:1789596769.093961:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2 00000100:00100000:0.0:1789596769.093970:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d142aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+11:2353:x1876527944883712:12345-192.168.202.44@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789596769.094420:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d142aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:2353:x1876527944883712:12345-192.168.202.44@tcp:4:lhsmtool_posix.0 Request processed in 449us (725us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789596769.094429:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2 00002000:00100000:0.0:1789596769.094436:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ea8d142aa00 x1876527944883712/t4294967308(0) o4->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:650/0 lens 504/448 e 0 to 0 dl 1789596780 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789596769.094444:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8d142aa00 with x1876527944883712 ext(0->12) 00002000:00010000:0.0:1789596769.094447:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ea8d142aa00 00000100:00100000:1.0:1789596769.094695:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d142a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1876527964816128:192.168.202.44@tcp:105: 00010000:00010000:1.0:1789596769.094718:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596769.094741:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c8283450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+12:2354:x1876527944883584:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 15240us (15637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596769.094749:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 54 00000100:00100000:3.0:1789596769.097715:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596769.097867:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944883840 00000100:00100000:0.0:1789596769.097880:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944883840 00000100:00100000:0.0:1789596769.097941:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 124 00000100:00100000:0.0:1789596769.097951:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c504b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+61:10548:x1876527944883840:12345-192.168.202.44@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789596769.160887:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:2.0:1789596769.160900:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789596769.160953:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ea8c569b480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1789596769.160959:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ea8c351d500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ea8c569b9c0 00000020:00080000:2.0:1789596769.160962:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ea8c351da00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ea900427c00 00000001:00080000:2.0:1789596769.160980:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1789596769.160988:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1789596769.161001:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ea8f652e300 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1789596769.161005:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ea8c516a900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ea8f652e3c0 00000020:00080000:2.0:1789596769.161007:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ea8c516ab00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ea8d5aa4c00 00000004:00080000:2.0:1789596769.161036:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789596769.161074:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1789596769.161278:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789596769.161395:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d1429c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964816256:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789596769.161601:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596769.161857:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964816512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789596769.161889:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596769.161916:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789596769.161923:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964816384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789596769.161944:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596769.162235:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964816256 00000100:00100000:0.0:1789596769.162244:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964816256 00000100:00100000:0.0:1789596769.162306:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964816512 00000100:00100000:0.0:1789596769.162310:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964816512 00000100:00100000:0.0:1789596769.162326:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964816384 00000100:00100000:0.0:1789596769.162328:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964816384 00000100:00100000:0.0:1789596769.162342:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789596769.162351:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d1429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3309:x1876527964816256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789596769.162380:0:9219:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00000100:00080000:1.0:1789596769.162576:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789596769.162580:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596769.162631:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789596769.162640:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1876527964816512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789596769.162784:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789596769.162788:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789596769 00002000:00010000:2.0:1789596769.162790:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789596769.162792:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789596769 -> 1789596769 00002000:00010000:2.0:1789596769.162794:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789596769.162873:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa435c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3307:x1876527964816512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 235us (983us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789596769.162880:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789596769.162907:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789596769.162912:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1876527964816384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789596769.162922:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1789596769.162935:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fbb916d/0x8973ae90b38d8201 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.162955:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005944294f/0x8973ae90b38d7fbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e6c expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.162963:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789596769.162967:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789596769.162971:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fbb916d/0x8973ae90b38d8201 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.162999:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005944294f/0x8973ae90b38d7fbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e6c expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.163013:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005944294f/0x8973ae90b38d7fbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e6c expref: 11 pid: 6695 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596769.163024:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d1428000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876527964816640:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789596769.163090:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d353e780 going to sleep for 11 seconds 00000004:00080000:1.0:1789596769.163292:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ea8fa436a00/2, rc 0, transno 4294967309 00000100:00100000:1.0:1789596769.163298:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa436a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964816512:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789596769.165306:0:9219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aab145f, atime: 0x6aab145f, ctime: 0x6aab145f, blocks: 0x1 00010000:00010000:0.0:1789596769.165327:0:9219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d81fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.165365:0:9219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=354s v=(0 0) 00010000:00010000:0.0:1789596769.165370:0:9219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596769.165376:0:9219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d81fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.165394:0:9219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d81fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.165406:0:9219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d81fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.165414:0:9219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d81fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.165508:0:9219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789596769.166147:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789596769.166156:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d81fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.166164:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483600 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:1.0:1789596769.166169:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d81fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.166177:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d81fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.166205:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d81fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.166214:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cd9a410/0x8973ae90b38d81fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.166236:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596769.166238:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596769.166240:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596769.166799:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d1429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3309:x1876527964816256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4444us (5194us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789596769.166810:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:2.0:1789596769.166928:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ea8d1429c00/2, rc 0, transno 4294967304 00000100:00100000:2.0:1789596769.166935:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d1429c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964816256:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789596769.167930:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c504b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+15:10548:x1876527944883840:12345-192.168.202.44@tcp:44:lhsmtool_posix.0 Request processed in 69975us (70218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596769.167941:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 124 00000100:00100000:1.0:1789596769.168176:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596769.168258:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d1428000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876527964816640:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789596769.168295:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001fbb916d/0x8973ae90b38d8201 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596769.170033:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596769.170156:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944883968 00000100:00100000:0.0:1789596769.170170:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944883968 00010000:00010000:0.0:1789596769.170222:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005944294f/0x8973ae90b38d7fbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e6c expref: 12 pid: 6695 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596769.170266:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 55 00000100:00100000:0.0:1789596769.170276:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+12:2354:x1876527944883968:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596769.170308:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596769.170315:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005944294f/0x8973ae90b38d7fbc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e6c expref: 12 pid: 6695 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.170328:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005944294f/0x8973ae90b38d7fbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e6c expref: 12 pid: 6695 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.170350:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005944294f/0x8973ae90b38d7fbc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e6c expref: 12 pid: 6695 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.170366:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789596769.170370:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789596769.170375:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001fbb916d/0x8973ae90b38d8201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.170385:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fbb916d/0x8973ae90b38d8201 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.170412:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596769.170530:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001fbb916d/0x8973ae90b38d8201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.170539:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fbb916d/0x8973ae90b38d8201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.170550:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fbb916d/0x8973ae90b38d8201 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.170556:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fbb916d/0x8973ae90b38d8201 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.170573:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789596769.171186:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa435500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3307:x1876527964816384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8270us (9238us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789596769.171195:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789596769.171215:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944884096 00000100:00100000:3.0:1789596769.171219:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944884096 00000100:00100000:3.0:1789596769.171246:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 43 00000100:00100000:3.0:1789596769.171253:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+12:2351:x1876527944884096:12345-192.168.202.44@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1789596769.171306:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596769.171313:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fbb916d/0x8973ae90b38d8201 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.171329:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427e00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:3.0:1789596769.171333:0:7643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fbb916d/0x8973ae90b38d8201 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.171343:0:7643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fbb916d/0x8973ae90b38d8201 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.171356:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fbb916d/0x8973ae90b38d8201 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.171363:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fbb916d/0x8973ae90b38d8201 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.171383:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596769.171385:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596769.171387:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789596769.173267:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ea8fa436300/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789596769.173282:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964816384:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789596769.173781:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa434000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+12:2354:x1876527944883968:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 3503us (5601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596769.173792:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 55 00010000:00010000:0.0:1789596769.180431:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789596769.206872:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1789596769.206901:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1789596769.206928:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:3.0:1789596769.207152:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2351:x1876527944884096:12345-192.168.202.44@tcp:16:lhsmtool_posix.0 Request processed in 35893us (37123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596769.207164:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 43 00000100:00100000:2.0:1789596769.210096:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596769.210174:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944884352 00000100:00100000:0.0:1789596769.210183:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944884352 00000100:00100000:0.0:1789596769.210312:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 125 00000100:00100000:0.0:1789596769.210322:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d142b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+15:10548:x1876527944884352:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789596769.210389:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596769.210416:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d81e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344eff expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.210567:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ea8e0eea700) 00010000:00010000:0.0:1789596769.210573:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596769.210676:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8208 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.210692:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8208 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.210703:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8208 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596769.211402:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c242f59c reply state 00000000e7fba438 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8208 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596769.211414:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789596769.211705:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d142b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:10548:x1876527944884352:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 Request processed in 1383us (1615us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789596769.211714:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 125 00000100:00100000:3.0:1789596769.214689:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596769.214786:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944884480 00000100:00100000:2.0:1789596769.214796:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944884480 00000100:00100000:2.0:1789596769.214867:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 44 00000100:00100000:2.0:1789596769.214877:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2353:x1876527944884480:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789596769.215135:0:9219:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789596769.215139:0:9219:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789596769 -> 1789596768 00002000:00010000:2.0:1789596769.215142:0:9219:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789596767 00002000:00010000:2.0:1789596769.215143:0:9219:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789596769 -> 1789596768 00002000:00010000:2.0:1789596769.215145:0:9219:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1789596769.215252:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8208 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.215280:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8208 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.215289:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8208 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.215295:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596769.215299:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8208 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.215307:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8208 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.215322:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ea8e0eea700) 00010000:00010000:1.0:1789596769.215325:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596769.215329:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8208 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.215335:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8208 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596769.216036:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2353:x1876527944884480:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 Request processed in 1154us (1352us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789596769.216047:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 44 00000100:00100000:3.0:1789596769.218599:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596769.218708:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944884736 00000100:00100000:2.0:1789596769.218719:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944884736 00000100:00100000:2.0:1789596769.218807:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 126 00000100:00100000:2.0:1789596769.218842:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c504ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+15:10548:x1876527944884736:12345-192.168.202.44@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789596769.218915:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d820f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.218953:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d81c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ef1 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.218963:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d820f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.218998:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d81c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ef1 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.219013:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d81c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ef1 expref: 15 pid: 5841 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596769.219027:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d1429180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1876527964816768:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789596769.219100:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6e5e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596769.222180:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596769.222249:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944884864 00000100:00100000:0.0:1789596769.222259:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944884864 00010000:00010000:0.0:1789596769.222295:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d81c9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ef1 expref: 16 pid: 5841 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596769.222338:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 56 00000100:00100000:0.0:1789596769.222347:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:2354:x1876527944884864:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596769.222361:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596769.222368:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d81c9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ef1 expref: 16 pid: 5841 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.222381:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d81c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ef1 expref: 16 pid: 5841 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.222435:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ea8e0eea700) 00010000:00010000:0.0:1789596769.222441:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d820f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.222451:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d820f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.222488:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d820f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.222510:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596769.222566:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa437800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:2354:x1876527944884864:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 220us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596769.222574:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 56 00010000:00010000:2.0:1789596769.224303:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d81c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ef1 expref: 15 pid: 5841 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596769.224326:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d1429180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1876527964816768:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789596769.224350:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d820f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.224359:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d820f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.224365:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d820f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.224397:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d820f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.224418:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d820f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.224436:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d820f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.224441:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596769.224445:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d820f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.224452:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d820f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.224474:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ea8e0eea700) 00010000:00010000:2.0:1789596769.224477:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789596769.224481:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d820f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.224487:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d820f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596769.224611:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c504ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:10548:x1876527944884736:12345-192.168.202.44@tcp:55:lhsmtool_posix.0 Request processed in 5795us (6022us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789596769.224621:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 126 00000100:00100000:1.0:1789596769.227474:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596769.227547:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944884992 00000100:00100000:3.0:1789596769.227558:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944884992 00000100:00100000:3.0:1789596769.227631:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 45 00000100:00100000:3.0:1789596769.227641:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2351:x1876527944884992:12345-192.168.202.44@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789596769.227686:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001d42dd2/0x8973ae90b38d8216 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.227707:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d81f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f0d expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.227716:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596769.227720:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789596769.227725:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d42dd2/0x8973ae90b38d8216 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.227759:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d81f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f0d expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.227773:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d81f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f0d expref: 7 pid: 6695 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596769.227788:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c504bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1876527964816896:192.168.202.44@tcp:104: 00000100:00100000:3.0:1789596769.227896:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff4b0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789596769.231410:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596769.231799:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944885120 00000100:00100000:2.0:1789596769.231809:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944885120 00010000:00010000:2.0:1789596769.231876:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d81f3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f0d expref: 8 pid: 6695 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596769.231916:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 57 00000100:00100000:2.0:1789596769.231938:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2353:x1876527944885120:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596769.231952:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596769.231974:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d81f3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f0d expref: 8 pid: 6695 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.231989:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d81f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f0d expref: 8 pid: 6695 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.232015:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789596769.232019:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789596769.232025:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001d42dd2/0x8973ae90b38d8216 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.232048:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d42dd2/0x8973ae90b38d8216 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.232070:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596769.232121:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa434a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2353:x1876527944885120:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 183us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596769.232128:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 57 00010000:00010000:3.0:1789596769.233330:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d81f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f0d expref: 7 pid: 6695 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596769.233349:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c504bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1876527964816896:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789596769.233369:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001d42dd2/0x8973ae90b38d8216 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.233519:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001d42dd2/0x8973ae90b38d8216 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.233529:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d42dd2/0x8973ae90b38d8216 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.233558:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000001d42dd2/0x8973ae90b38d8216 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.233572:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d42dd2/0x8973ae90b38d8216 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.233580:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d42dd2/0x8973ae90b38d8216 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.233587:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89e00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596769.233684:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d42dd2/0x8973ae90b38d8216 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.233694:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d42dd2/0x8973ae90b38d8216 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.233710:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d42dd2/0x8973ae90b38d8216 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.233718:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d42dd2/0x8973ae90b38d8216 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596769.233852:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa435180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2351:x1876527944884992:12345-192.168.202.44@tcp:1:lhsmtool_posix.0 Request processed in 6212us (6397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596769.233861:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 45 00000100:00100000:1.0:1789596769.240868:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596769.240952:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944885376 00000100:00100000:3.0:1789596769.240963:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944885376 00000100:00100000:3.0:1789596769.241031:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 127 00000100:00100000:3.0:1789596769.241051:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:10548:x1876527944885376:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789596769.241143:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d821d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.241164:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d821d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.241179:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d821d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.241592:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8224 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.241606:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d81d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ef8 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.241614:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8224 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.241648:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d81d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ef8 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.241663:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d81d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ef8 expref: 15 pid: 5841 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596769.241694:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c504bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1876527964817024:192.168.202.44@tcp:104: 00000100:00100000:3.0:1789596769.241943:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff4b0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596769.246203:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596769.246717:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c504bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1876527964817024:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789596769.246747:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8224 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596769.246802:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944885504 00000100:00100000:2.0:1789596769.246810:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944885504 00010000:00010000:2.0:1789596769.246866:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d81d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ef8 expref: 16 pid: 5841 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596769.246963:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 58 00000100:00100000:2.0:1789596769.246972:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef765f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:2353:x1876527944885504:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596769.246986:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596769.246993:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d81d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ef8 expref: 16 pid: 5841 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.247005:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d81d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ef8 expref: 16 pid: 5841 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.247031:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d81d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ef8 expref: 16 pid: 5841 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.247046:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ea8e0eea700) 00010000:00010000:2.0:1789596769.247051:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8224 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.247061:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8224 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.247068:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8224 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.247093:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596769.247152:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef765f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+15:2353:x1876527944885504:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 181us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596769.247159:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 58 00010000:00010000:3.0:1789596769.247212:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8224 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.247219:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8224 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789596769.247404:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1789596769.247560:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1789596769.247620:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1789596769.247692:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c504bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1876527964817152:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789596769.247740:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596769.247768:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff4b06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596769.248892:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964817152 00000100:00100000:1.0:1789596769.248902:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964817152 00000100:00100000:1.0:1789596769.248943:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789596769.248951:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c504a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1876527964817152:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789596769.249048:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c504a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1876527964817152:12345-0@lo:1000:mdt00_000.0 Request processed in 97us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596769.249068:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789596769.249297:0:5841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789596769.249303:0:5841:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1789596769.249321:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ea8fa436a00, transno 4294967309 00000004:00080000:3.0:1789596769.249337:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ea8fa436300, transno 4294967310 00000100:00100000:3.0:1789596769.249344:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c504bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1876527964817152:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789596769.249849:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1789596769.249930:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c504bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1876527964817280:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789596769.249971:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596769.250173:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff4b0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789596769.251145:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964817280 00000100:00100000:0.0:1789596769.251159:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964817280 00000100:00100000:0.0:1789596769.251284:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789596769.251296:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c504a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1876527964817280:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789596769.251749:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c504a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1876527964817280:12345-0@lo:1000:mdt00_000.0 Request processed in 456us (1776us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789596769.251758:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789596769.253971:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c504bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5841:1876527964817280:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789596769.254516:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8224 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.254545:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8224 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.254554:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8224 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.254562:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596769.254567:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8224 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.254575:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8224 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.254592:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ea8e0eea700) 00010000:00010000:2.0:1789596769.254595:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596769.254601:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8224 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.254607:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8224 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.254642:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8167 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.254649:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8167 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.254655:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8167 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.254660:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1482400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596769.254669:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8167 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.254675:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8167 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.254684:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:2.0:1789596769.254686:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596769.254694:0:5841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d816e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344edc expref: 18 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.254706:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d816e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344edc expref: 18 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.254715:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d816e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344edc expref: 18 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.254753:0:5841:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d816e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344edc expref: 18 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596769.254770:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d1429180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1876527964817408:192.168.202.44@tcp:105: 00000100:00100000:2.0:1789596769.254999:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6e5e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596769.258583:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596769.259085:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d1429180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1876527964817408:192.168.202.44@tcp:105: 00010000:00010000:2.0:1789596769.259116:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8167 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.259126:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8167 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.259181:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d822b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.259205:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d822b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.259218:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d822b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.259228:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d822b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.259234:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d822b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.259241:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d822b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.259246:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596769.259251:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d822b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.259258:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d822b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.259269:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:2.0:1789596769.259272:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596769.259276:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d822b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.259283:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d822b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.259300:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d821d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.259306:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d821d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.259312:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d821d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.259317:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596769.259321:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d821d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.259327:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d821d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.259335:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:2.0:1789596769.259337:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789596769.259341:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d821d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.259347:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d821d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596769.259813:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa435880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:10548:x1876527944885376:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 Request processed in 18769us (18950us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1789596769.259849:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 127 00000020:00080000:2.0:1789596769.259858:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789596769.260065:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789596769.260070:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789596769.260098:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789596769.260104:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789596769.260408:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944885632 00000100:00100000:1.0:1789596769.260415:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944885632 00000100:00100000:1.0:1789596769.260479:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 31 00000100:00100000:1.0:1789596769.260489:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:10546:x1876527944885632:12345-192.168.202.44@tcp:49:lfs.0 00000100:00100000:1.0:1789596769.260580:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:10546:x1876527944885632:12345-192.168.202.44@tcp:49:lfs.0 Request processed in 93us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596769.260587:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 31 00000100:00100000:0.0:1789596769.264661:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596769.264783:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596769.265227:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944886144 00000100:00100000:1.0:1789596769.265238:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944886144 00000100:00100000:1.0:1789596769.265298:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 128 00000100:00100000:1.0:1789596769.265308:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:10546:x1876527944886144:12345-192.168.202.44@tcp:58:lfs.0 00000040:00080000:1.0:1789596769.265740:0:10902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789596769.265852:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:10546:x1876527944886144:12345-192.168.202.44@tcp:58:lfs.0 Request processed in 511us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596769.265860:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 128 00000100:00100000:3.0:1789596769.270236:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944885888 00000100:00100000:3.0:1789596769.270254:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944885888 00000100:00100000:2.0:1789596769.270492:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 32 00000100:00100000:2.0:1789596769.270503:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3551c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:10548:x1876527944885888:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789596769.271401:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789596769.271529:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1789596769.271707:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8232 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.271725:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8232 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.271739:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8232 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.271749:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8232 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.271756:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8232 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.271763:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8232 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.271953:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789596769.272057:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3551c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:10548:x1876527944885888:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 Request processed in 1553us (7462us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789596769.272066:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 32 00000020:00080000:2.0:1789596769.272072:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789596769.278358:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596769.278372:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8232 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.278383:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:3.0:1789596769.278388:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8232 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.278398:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8232 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.278417:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ea8e0eea100) 00010000:00010000:3.0:1789596769.278549:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789596769.278556:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8232 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.278563:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8232 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596769.286021:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596769.286031:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596769.286034:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596769.299623:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596769.299759:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944886272 00000100:00100000:1.0:1789596769.299770:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944886272 00000100:00100000:1.0:1789596769.299856:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 129 00000100:00100000:1.0:1789596769.299867:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:10550:x1876527944886272:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:1.0:1789596769.299891:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596769.299912:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8239 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f14 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.299975:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8240 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.300003:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8240 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.300016:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8240 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.300033:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8247 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.300041:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.300048:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.300441:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d824e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.300453:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ed5 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.300470:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d824e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.300504:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ed5 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596769.300518:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ed5 expref: 21 pid: 5843 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596769.300544:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa436a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964817536:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789596769.300682:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789596769.304102:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596769.305073:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944886528 00000100:00100000:2.0:1789596769.305085:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944886528 00000100:00100000:2.0:1789596769.305200:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 33 00000100:00100000:2.0:1789596769.305221:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:5590:x1876527944886528:12345-192.168.202.44@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789596769.306056:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:5590:x1876527944886528:12345-192.168.202.44@tcp:35:ldlm_bl.0 Request processed in 830us (1958us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1789596769.306064:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 33 00000100:00100000:3.0:1789596769.307888:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596769.308233:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa436a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964817536:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596769.308264:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d824e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596769.309805:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944886656 00000100:00100000:3.0:1789596769.309837:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944886656 00010000:00010000:3.0:1789596769.309889:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ed5 expref: 23 pid: 5843 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596769.309951:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 59 00000100:00100000:3.0:1789596769.309961:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c504aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:2354:x1876527944886656:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596769.309977:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596769.309985:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ed5 expref: 23 pid: 5843 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.309998:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ed5 expref: 23 pid: 5843 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.310023:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d8159 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ed5 expref: 23 pid: 5843 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.310041:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:3.0:1789596769.310047:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d824e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.310058:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d824e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.310067:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d824e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596769.310094:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596769.310154:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c504aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:2354:x1876527944886656:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 195us (2276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596769.310162:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 59 00010000:00010000:0.0:1789596769.313120:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d824e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.313134:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d824e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596769.313184:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789596769.313189:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789596769.313219:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d824e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.313235:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d824e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.313246:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8240 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.313253:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8240 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.313261:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8240 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.313267:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596769.313271:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8240 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.313279:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8240 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.313293:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:0.0:1789596769.313296:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596769.313301:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8240 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.313325:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8240 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.313339:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8247 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.313345:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8247 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.313351:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8247 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.313356:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596769.313359:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8247 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.313365:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8247 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.313374:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ea8c36d5500) 00010000:00010000:0.0:1789596769.313377:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596769.313379:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8247 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.313385:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8247 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.313549:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8239 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f14 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.313567:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d824e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f14 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596769.313581:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:0.0:1789596769.313583:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596769.313587:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32a00, rc 0) 00000100:00100000:0.0:1789596769.313658:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:10550:x1876527944886272:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 13791us (14042us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596769.313667:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 129 00000100:00100000:2.0:1789596769.640990:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596769.641047:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596769.641075:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596769.641094:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944887168 00000100:00100000:2.0:1789596769.641100:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596769.641107:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944887168 00000100:00100000:2.0:1789596769.641125:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596769.641149:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944886784 00000100:00100000:2.0:1789596769.641154:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944886784 00000100:00100000:0.0:1789596769.641175:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944887040 00000100:00100000:0.0:1789596769.641180:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944887040 00000100:00100000:2.0:1789596769.641193:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 286 00000100:00100000:2.0:1789596769.641202:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2351:x1876527944886784:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596769.641271:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2351:x1876527944886784:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 69us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596769.641275:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 59 00000100:00100000:2.0:1789596769.641284:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 286 00000100:00100000:0.0:1789596769.641359:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d1429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:2351:x1876527944887168:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596769.641392:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d1429180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:2351:x1876527944887168:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 39us (352us total) trans 0 rc 0/0 00000100:00080000:1.0:1789596769.641395:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789596769.641731:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944886912 00000100:00100000:3.0:1789596769.641749:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944886912 00000100:00100000:3.0:1789596769.641780:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944887296 00000100:00100000:3.0:1789596769.641782:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944887296 00000100:00100000:3.0:1789596769.641928:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 133 00000100:00100000:3.0:1789596769.641936:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d142ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:2351:x1876527944886912:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596769.644046:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d142ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:2351:x1876527944886912:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 2105us (3060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596769.644973:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 133 00000100:00100000:3.0:1789596769.645019:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 134 00000100:00100000:3.0:1789596769.645036:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d1429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2351:x1876527944887296:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596769.645079:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d1429880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2351:x1876527944887296:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 52us (3955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596769.645086:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 134 00000100:00100000:2.0:1789596769.646179:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 60 00000100:00100000:2.0:1789596769.646199:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d1428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2351:x1876527944887040:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596769.646258:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d1428a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2351:x1876527944887040:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 69us (5160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596769.646266:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 60 00000100:00080000:1.0:1789596769.648730:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596769.652107:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 59 00000001:00080000:1.0:1789596769.883608:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1789596769.883629:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:1.0:1789596769.883644:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000040:00080000:2.0:1789596770.050380:0:12069:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789596770.050390:0:12069:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789596770.050566:0:12069:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789596770.050573:0:12069:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789596770.209156:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789596770.267070:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789596770.267080:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789596770.267145:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789596770.267151:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789596770.267298:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5049c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876527964817664:192.168.202.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789596770.267393:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff4b0900 going to sleep for 11 seconds 00000100:00100000:2.0:1789596770.270167:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596770.270294:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5049c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876527964817664:192.168.202.44@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789596770.270721:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944887424 00000100:00100000:1.0:1789596770.270730:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944887424 00000100:00100000:1.0:1789596770.271539:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 130 00000100:00100000:1.0:1789596770.271554:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d1428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:10562:x1876527944887424:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789596770.271617:0:10902:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789596770.271731:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d1428700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:10562:x1876527944887424:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 Request processed in 180us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596770.271738:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 130 00000100:00100000:3.0:1789596770.276312:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596770.276589:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944887680 00000100:00100000:0.0:1789596770.276600:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944887680 00000100:00100000:0.0:1789596770.276664:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 131 00000100:00100000:0.0:1789596770.276674:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:10562:x1876527944887680:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789596770.276698:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596770.276719:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8255 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f1b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596770.276872:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d825c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596770.276902:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d825c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596770.276915:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d825c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596770.276926:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789596770.277128:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8255 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f1b expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596770.277148:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d825c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f1b expref: 23 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596770.277157:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:0.0:1789596770.277160:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596770.277164:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c1482400, rc 0) 00000100:00100000:0.0:1789596770.277549:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:10562:x1876527944887680:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 875us (1246us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789596770.277556:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 131 00000100:00080000:2.0:1789596770.277632:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596770.282569:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596770.282675:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596770.283124:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944888064 00000100:00100000:2.0:1789596770.283136:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944888064 00000100:00100000:1.0:1789596770.283316:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944887936 00000100:00100000:1.0:1789596770.283321:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944887936 00000100:00100000:1.0:1789596770.283500:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 132 00000100:00100000:1.0:1789596770.283510:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+24:10562:x1876527944887936:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789596770.283586:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d826a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596770.283617:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d826a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596770.283628:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d826a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596770.283858:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d826a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596770.283866:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d826a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596770.283874:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d826a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596770.283880:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a33000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596770.283884:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d826a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596770.283891:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d826a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596770.283901:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:1.0:1789596770.283904:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789596770.283909:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d826a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596770.283915:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d826a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596770.284136:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+25:10562:x1876527944887936:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 Request processed in 627us (1577us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789596770.284150:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 132 00000040:00080000:2.0:1789596770.284316:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789596770.284321:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1789596770.284557:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 8 00000100:00100000:3.0:1789596770.284566:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff564a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+24:2351:x1876527944888064:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596770.284578:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596770.284593:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d825c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f1b expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596770.284613:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:3.0:1789596770.284616:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596770.284638:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff564a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:2351:x1876527944888064:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 73us (1963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596770.284645:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 8 00000040:00080000:2.0:1789596770.285518:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789596770.285532:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789596770.288652:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596770.289359:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944888320 00000100:00100000:0.0:1789596770.289370:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944888320 00000100:00100000:0.0:1789596770.289510:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 34 00000100:00100000:0.0:1789596770.289522:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:10562:x1876527944888320:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789596770.289846:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa436a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+24:10562:x1876527944888320:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 Request processed in 325us (1207us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789596770.289870:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 34 00010000:00010000:0.0:1789596771.230657:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596771.354999:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789596771.355023:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d1428e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964817792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596771.355092:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596771.355257:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964817792 00000100:00100000:0.0:1789596771.355267:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964817792 00000100:00100000:0.0:1789596771.355562:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789596771.355573:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d142b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876527964817792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789596771.355610:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596771.355663:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d142b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876527964817792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596771.355670:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1789596771.356088:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596771.356146:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d1428e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964817792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596771.867952:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964818048:0@lo:400:kworker.0 00000100:00100000:0.0:1789596771.868032:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596771.868108:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596771.868115:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964818176:0@lo:400:kworker.0 00000100:00100000:0.0:1789596771.868141:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596771.868188:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964818048 00000100:00100000:0.0:1789596771.868196:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964818048 00000100:00100000:0.0:1789596771.868238:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964818176 00000100:00100000:0.0:1789596771.868241:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964818176 00000100:00100000:0.0:1789596771.868268:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789596771.868276:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964818048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596771.868327:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964818048:12345-0@lo:400:kworker.0 Request processed in 52us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596771.868333:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789596771.868350:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789596771.868356:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964818176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596771.868398:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964818176:12345-0@lo:400:kworker.0 Request processed in 42us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596771.868403:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789596771.868455:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa434e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964818176:0@lo:400:kworker.0 00000100:00100000:0.0:1789596771.868467:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa434700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964818048:0@lo:400:kworker.0 00000100:00100000:2.0:1789596771.868603:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964817920:0@lo:400:kworker.0 00000100:00100000:2.0:1789596771.868642:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596771.868676:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964818432:0@lo:400:kworker.0 00000100:00100000:2.0:1789596771.868701:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596771.868734:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789596771.868740:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964818304:0@lo:400:kworker.0 00000100:00100000:2.0:1789596771.868762:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789596771.868785:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596771.868799:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964818432 00000100:00100000:2.0:1789596771.868802:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964818432 00000100:00100000:2.0:1789596771.868860:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789596771.868869:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d1428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964818432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596771.868905:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d1428e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964818432:12345-0@lo:400:kworker.0 Request processed in 38us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596771.868923:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1789596771.868943:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596771.868959:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1789596771.868965:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:2.0:1789596771.868979:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ea8f7496300, transno 4294967301 00000004:00080000:2.0:1789596771.868990:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1789596771.868999:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ea8d1429c00, transno 4294967304 00000100:00100000:2.0:1789596771.869151:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa435f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964818432:0@lo:400:kworker.0 00000100:00100000:0.0:1789596771.869242:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964817920 00000100:00100000:0.0:1789596771.869246:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964817920 00000100:00100000:0.0:1789596771.869274:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789596771.869280:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3309:x1876527964817920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596771.869315:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3309:x1876527964817920:12345-0@lo:400:kworker.0 Request processed in 34us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596771.869321:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789596771.869406:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964818304 00000100:00100000:2.0:1789596771.869411:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964818304 00000100:00100000:2.0:1789596771.869461:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1789596771.869514:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596771.869594:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa436300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964817920:0@lo:400:kworker.0 00000100:00100000:2.0:1789596771.870229:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d1429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964818304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596771.870334:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d1429f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964818304:12345-0@lo:400:kworker.0 Request processed in 866us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596771.870342:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789596771.875576:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964818304:0@lo:400:kworker.0 00000040:00080000:2.0:1789596772.115112:0:12120:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789596772.115121:0:12120:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789596772.115166:0:12120:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789596772.115173:0:12120:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789596772.259374:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596772.341201:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596772.341337:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944888576 00000100:00100000:0.0:1789596772.341347:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944888576 00000100:00100000:0.0:1789596772.341423:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 133 00000100:00100000:0.0:1789596772.341442:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d1429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+24:10582:x1876527944888576:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789596772.341468:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596772.341491:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8271 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f22 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596772.341596:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8278 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596772.341610:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8278 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596772.341639:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8278 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596772.341652:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789596772.341785:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8271 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f22 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596772.341806:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8278 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f22 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596772.341838:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:0.0:1789596772.341842:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789596772.341846:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c1482400, rc 0) 00000100:00100000:0.0:1789596772.341902:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d1429c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:10582:x1876527944888576:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 470us (711us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1789596772.341909:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 133 00000100:00080000:2.0:1789596772.342336:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596772.347308:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596772.355877:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944888704 00000100:00100000:2.0:1789596772.355893:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944888704 00000100:00100000:2.0:1789596772.355960:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 134 00000100:00100000:2.0:1789596772.355971:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:10582:x1876527944888704:12345-192.168.202.44@tcp:54:lfs.0 00010000:00010000:2.0:1789596772.356039:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8286 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596772.356070:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596772.356083:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596772.356283:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8286 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596772.356292:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8286 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596772.356299:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8286 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596772.356305:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596772.356310:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8286 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596772.356319:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8286 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596772.356332:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:2.0:1789596772.356335:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789596772.356340:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8286 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596772.356347:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d8286 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596772.356427:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:10582:x1876527944888704:12345-192.168.202.44@tcp:54:lfs.0 Request processed in 457us (9128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596772.356453:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 134 00000100:00100000:2.0:1789596772.379063:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789596772.379097:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c570b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964818560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596772.379685:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596772.379801:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964818560 00000100:00100000:0.0:1789596772.379811:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964818560 00000100:00100000:0.0:1789596772.379891:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789596772.379900:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d142b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964818560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596772.379937:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596772.379991:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d142b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964818560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596772.379999:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789596772.380046:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c570b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964818560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596772.453043:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596772.453108:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944888832 00000100:00100000:1.0:1789596772.453119:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944888832 00000100:00100000:1.0:1789596772.453193:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 46 00000100:00100000:1.0:1789596772.453203:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d1429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2353:x1876527944888832:12345-192.168.202.44@tcp:101:cat.0 00010000:00010000:1.0:1789596772.453223:0:9219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596772.453245:0:9219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ba9fc74/0x8973ae90b38d828d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f29 expref: -99 pid: 9219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789596772.453271:0:9219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aab1460, atime: 0x6aab145f, ctime: 0x6aab1460, blocks: 0xb 00010000:00010000:1.0:1789596772.453292:0:9219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=357s v=(0 0) 00010000:00010000:1.0:1789596772.453296:0:9219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596772.453305:0:9219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ba9fc74/0x8973ae90b38d828d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f29 expref: 7 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596772.453322:0:9219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ba9fc74/0x8973ae90b38d828d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f29 expref: 7 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596772.453335:0:9219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32000, rc 0) 00000100:00100000:1.0:1789596772.453393:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d1429500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2353:x1876527944888832:12345-192.168.202.44@tcp:101:cat.0 Request processed in 192us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596772.453400:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 46 00000100:00080000:2.0:1789596772.453610:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596772.457487:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596772.457605:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944888960 00000100:00100000:1.0:1789596772.457616:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944888960 00002000:00100000:1.0:1789596772.457682:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9ea8d1428000 x1876527944888960/t0(0) o3->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:653/0 lens 488/0 e 0 to 0 dl 1789596783 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789596772.457693:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8d1428000 with x1876527944888960 ext(0->4095) 00002000:00010000:1.0:1789596772.457698:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ea8d1428000 00000100:00100000:1.0:1789596772.457720:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 3 00000100:00100000:1.0:1789596772.457729:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d1428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2354:x1876527944888960:12345-192.168.202.44@tcp:3:cat.0 00000100:00100000:1.0:1789596772.457976:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d1428000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2354:x1876527944888960:12345-192.168.202.44@tcp:3:cat.0 Request processed in 247us (499us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789596772.457985:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 3 00002000:00100000:1.0:1789596772.457992:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9ea8d1428000 x1876527944888960/t0(0) o3->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:653/0 lens 488/4536 e 0 to 0 dl 1789596783 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789596772.457999:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8d1428000 with x1876527944888960 ext(0->4095) 00002000:00010000:1.0:1789596772.458002:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ea8d1428000 00010000:00010000:3.0:1789596773.279878:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596774.299147:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789596774.491678:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1789596774.491742:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1789596774.491762:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ea8ff4b06c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1789596774.491768:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ea8ff9fa800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ea8ff4b0240 00000020:00080000:2.0:1789596774.491771:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ea8ff9fa900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ea8ff444c00 00000020:00080000:2.0:1789596774.491797:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1789596774.492095:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1789596774.519536:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1789596774.519658:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:2.0:1789596774.759589:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596774.759624:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596774.759656:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596774.759740:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944889088 00000100:00100000:3.0:1789596774.759750:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944889088 00000100:00100000:3.0:1789596774.759797:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 288 00000100:00100000:3.0:1789596774.759834:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2352:x1876527944889088:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596774.759897:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2352:x1876527944889088:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 92us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596774.759904:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 288 00000100:00100000:0.0:1789596774.760363:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944889344 00000100:00100000:0.0:1789596774.760428:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944889344 00000100:00100000:0.0:1789596774.760476:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 62 00000100:00100000:0.0:1789596774.760483:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d142bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2352:x1876527944889344:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596774.760512:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d142bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2352:x1876527944889344:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 31us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596774.760518:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 62 00000100:00080000:2.0:1789596774.760647:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596774.761879:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596774.762022:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596774.762164:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944889600 00000100:00100000:1.0:1789596774.762171:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944889600 00000100:00100000:1.0:1789596774.762222:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944889216 00000100:00100000:1.0:1789596774.762225:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944889216 00000100:00100000:1.0:1789596774.762243:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 138 00000100:00100000:1.0:1789596774.762249:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d142a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2352:x1876527944889600:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596774.762299:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d142a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2352:x1876527944889600:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 50us (2642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596774.762305:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 138 00000100:00100000:1.0:1789596774.762318:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 139 00000100:00100000:1.0:1789596774.762323:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c570b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:2352:x1876527944889216:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596774.762341:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c570b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:2352:x1876527944889216:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 18us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596774.762356:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 139 00000100:00080000:0.0:1789596774.762519:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596774.762612:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944889472 00000100:00100000:2.0:1789596774.762620:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944889472 00000100:00100000:2.0:1789596774.762694:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 63 00000100:00100000:2.0:1789596774.762702:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2352:x1876527944889472:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596774.762747:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5708a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2352:x1876527944889472:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 37us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596774.762764:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 63 00000100:00080000:0.0:1789596774.762843:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789596775.324843:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596776.354853:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596776.479497:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596776.479520:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c570aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964818688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596776.479590:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596776.479654:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964818688 00000100:00100000:0.0:1789596776.479661:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964818688 00000100:00100000:0.0:1789596776.479716:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789596776.479725:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c570a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964818688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789596776.479758:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596776.479801:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c570a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964818688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596776.479808:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1789596776.479850:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596776.479881:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1789596776.479886:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1789596776.479914:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c570aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964818688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596776.991444:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876527964818944:0@lo:400:kworker.0 00000100:00100000:3.0:1789596776.991507:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964818816:0@lo:400:kworker.0 00000100:00100000:0.0:1789596776.991575:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964819072:0@lo:400:kworker.0 00000100:00100000:3.0:1789596776.994881:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596776.995110:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596776.995206:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876527964819200:0@lo:400:kworker.0 00000100:00100000:1.0:1789596776.995241:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596776.995281:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964818944 00000100:00100000:1.0:1789596776.995290:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964818944 00000100:00100000:1.0:1789596776.995333:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964819200 00000100:00100000:1.0:1789596776.995336:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964819200 00000100:00100000:1.0:1789596776.995726:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789596776.995738:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876527964818944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596776.995804:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa437100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876527964818944:12345-0@lo:400:kworker.0 Request processed in 69us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596776.995812:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789596776.995857:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789596776.995864:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876527964819200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596776.995895:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa434380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876527964819200:12345-0@lo:400:kworker.0 Request processed in 32us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596776.995900:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789596776.995945:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876527964819200:0@lo:400:kworker.0 00000100:00100000:1.0:1789596776.995981:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876527964818944:0@lo:400:kworker.0 00000100:00100000:0.0:1789596776.996609:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789596776.996688:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596776.996808:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964819072 00000100:00100000:1.0:1789596776.996847:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964819072 00000100:00100000:1.0:1789596776.996892:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789596776.996909:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c570aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964819072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596776.996961:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c570aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964819072:12345-0@lo:400:kworker.0 Request processed in 54us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596776.996968:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:0.0:1789596776.997231:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596776.997260:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964819072:0@lo:400:kworker.0 00000100:00100000:3.0:1789596776.997583:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964819328:0@lo:400:kworker.0 00000100:00100000:3.0:1789596776.997759:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596776.997979:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964818816 00000100:00100000:3.0:1789596776.997985:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964818816 00000100:00100000:3.0:1789596776.998028:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789596776.998035:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964818816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596776.998090:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964818816:12345-0@lo:400:kworker.0 Request processed in 56us (3216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596776.998096:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789596776.998148:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964818816:0@lo:400:kworker.0 00000100:00100000:0.0:1789596777.001812:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964819328 00000100:00100000:0.0:1789596777.001845:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964819328 00000100:00100000:0.0:1789596777.001928:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789596777.001939:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964819328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596777.002037:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964819328:12345-0@lo:400:kworker.0 Request processed in 100us (4278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596777.002045:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789596777.002099:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964819328:0@lo:400:kworker.0 00000100:00080000:1.0:1789596777.002871:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596777.303104:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596777.303223:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944889728 00000100:00100000:1.0:1789596777.303235:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944889728 00000100:00100000:1.0:1789596777.303311:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 135 00000100:00100000:1.0:1789596777.303322:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:10236:x1876527944889728:12345-192.168.202.44@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789596777.303459:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5709500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:10236:x1876527944889728:12345-192.168.202.44@tcp:60:lhsmtool_posix.0 Request processed in 138us (366us total) trans 0 rc 0/0 00000100:00080000:0.0:1789596777.303465:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596777.303467:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 135 00000100:00100000:3.0:1789596777.305996:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596777.306221:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944889984 00000100:00100000:2.0:1789596777.306233:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944889984 00000100:00100000:2.0:1789596777.306302:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 35 00000100:00100000:2.0:1789596777.306312:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:10236:x1876527944889984:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789596777.306699:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:10236:x1876527944889984:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 Request processed in 388us (710us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789596777.306707:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 35 00010000:00010000:3.0:1789596777.371026:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596777.499055:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596777.499078:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f7496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964819456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596777.499159:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596777.499543:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964819456 00000100:00100000:1.0:1789596777.499552:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964819456 00000100:00100000:1.0:1789596777.499925:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789596777.499939:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c504b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964819456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789596777.499978:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789596777.500045:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c504b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964819456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596777.500052:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789596777.500146:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f7496300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964819456:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789596778.396862:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789596779.384053:0:12319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 18:12:57 (1789596777) 00010000:00010000:1.0:1789596779.422788:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789596779.483907:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789596779.483918:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789596779.484562:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1789596779.484570:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1789596779.673238:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1789596779.673257:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1789596779.673277:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1789596779.673287:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789596779.878153:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596779.878231:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596779.878277:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596779.878312:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596779.878347:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596779.878459:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944890368 00000100:00100000:1.0:1789596779.878470:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944890368 00000100:00100000:1.0:1789596779.878557:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944890496 00000100:00100000:1.0:1789596779.878561:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944890496 00000100:00100000:1.0:1789596779.878589:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 65 00000100:00100000:1.0:1789596779.878598:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2351:x1876527944890368:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596779.878672:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2351:x1876527944890368:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 74us (440us total) trans 0 rc 0/0 00000100:00080000:2.0:1789596779.878676:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789596779.878679:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 65 00000100:00080000:2.0:1789596779.878680:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596779.878699:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 66 00000100:00100000:1.0:1789596779.878706:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2351:x1876527944890496:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596779.878723:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944890624 00000100:00100000:2.0:1789596779.878727:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944890624 00000100:00100000:1.0:1789596779.878730:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2351:x1876527944890496:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596779.878736:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 66 00000100:00100000:3.0:1789596779.878858:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944890112 00000100:00100000:3.0:1789596779.878863:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944890112 00000100:00080000:3.0:1789596779.878901:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596779.878936:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 290 00000100:00100000:3.0:1789596779.878943:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2351:x1876527944890112:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596779.878971:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2351:x1876527944890112:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 30us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596779.878977:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 290 00000100:00100000:2.0:1789596779.879134:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944890240 00000100:00100000:2.0:1789596779.879139:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944890240 00000100:00080000:3.0:1789596779.879216:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596779.892320:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 143 00000100:00100000:1.0:1789596779.892373:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2351:x1876527944890624:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596779.892419:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 144 00000100:00100000:1.0:1789596779.892501:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2351:x1876527944890624:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 154us (14222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596779.892509:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 143 00000100:00100000:3.0:1789596779.892510:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:2351:x1876527944890240:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596779.892576:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:2351:x1876527944890240:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 147us (14263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596779.892583:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 144 00010000:00010000:3.0:1789596780.443578:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596780.811731:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596780.812228:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944890880 00000100:00100000:0.0:1789596780.812240:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944890880 00000100:00100000:0.0:1789596780.812305:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 136 00000100:00100000:0.0:1789596780.812323:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:11293:x1876527944890880:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789596780.812343:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596780.812373:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8294 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f30 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.812447:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d829b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.812462:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d829b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.812487:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d829b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.812533:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d82a2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.812542:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d82a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.812549:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d82a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.813162:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.813173:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.813181:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596780.813190:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789596780.813458:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d829b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.813466:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d829b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.813473:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d829b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.813479:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596780.813490:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d829b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.813498:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d829b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.813511:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ea8e0eeaf00) 00010000:00010000:0.0:1789596780.813514:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596780.813519:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d829b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.813525:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d829b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.813540:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d82a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.813546:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d82a2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.813551:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d82a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.813555:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596780.813558:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d82a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.813564:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d82a2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.813571:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ea8d55e5500) 00010000:00010000:0.0:1789596780.813574:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596780.813583:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d82a2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.813589:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d82a2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.814281:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8294 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f30 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.814298:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f30 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596780.814305:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ea8d55e5800) 00010000:00010000:0.0:1789596780.814308:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596780.814310:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030c00, rc 0) 00000100:00100000:0.0:1789596780.814400:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+15:11293:x1876527944890880:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 2085us (2676us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789596780.814409:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 136 00000100:00100000:1.0:1789596780.830648:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596780.830742:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944891008 00000100:00100000:3.0:1789596780.830755:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944891008 00000100:00100000:3.0:1789596780.830863:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 137 00000100:00100000:3.0:1789596780.830873:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+15:11293:x1876527944891008:12345-192.168.202.44@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789596780.830989:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+15:11293:x1876527944891008:12345-192.168.202.44@tcp:59:lhsmtool_posix.0 Request processed in 117us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596780.830997:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 137 00000100:00100000:3.0:1789596780.845612:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596780.845808:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944891136 00000100:00100000:2.0:1789596780.845848:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944891136 00000100:00100000:2.0:1789596780.845920:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 9 00000100:00100000:2.0:1789596780.846011:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c8281050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+15:2353:x1876527944891136:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596780.846052:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596780.846080:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82a9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f30 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596780.846326:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ea8d55e5800) 00010000:00010000:2.0:1789596780.846331:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596780.846468:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c8281050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:2353:x1876527944891136:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 538us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596780.846476:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 9 00010000:00010000:2.0:1789596781.467134:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789596781.534621:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789596781.534631:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789596781.534667:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1789596781.534675:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789596781.595703:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789596781.595726:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964819584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596781.595798:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596781.595890:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964819584 00000100:00100000:2.0:1789596781.595898:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964819584 00000100:00100000:2.0:1789596781.595954:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789596781.595963:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964819584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596781.595996:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789596781.596042:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964819584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596781.596048:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1789596781.596069:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596781.596120:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef765f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964819584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596782.112335:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f7497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964820096:0@lo:400:kworker.0 00000100:00100000:0.0:1789596782.112422:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596782.112483:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789596782.112490:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f7495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964819712:0@lo:400:kworker.0 00000100:00100000:0.0:1789596782.112521:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596782.112547:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f7496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964820224:0@lo:400:kworker.0 00000100:00100000:0.0:1789596782.112573:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596782.112781:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964820096 00000100:00100000:2.0:1789596782.112791:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964820096 00000100:00100000:2.0:1789596782.112861:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789596782.112871:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964820096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596782.112924:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964820096:12345-0@lo:400:kworker.0 Request processed in 55us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596782.112931:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789596782.113034:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f7497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964820096:0@lo:400:kworker.0 00000100:00100000:0.0:1789596782.113061:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f7494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964819840:0@lo:400:kworker.0 00000100:00100000:0.0:1789596782.113101:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596782.113119:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f7495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964820352:0@lo:400:kworker.0 00000100:00100000:0.0:1789596782.113138:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596782.113156:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596782.113162:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f7495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964819968:0@lo:400:kworker.0 00000100:00100000:0.0:1789596782.113196:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596782.113232:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964819712 00000100:00100000:0.0:1789596782.113237:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964819712 00000100:00100000:0.0:1789596782.113266:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789596782.113274:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964819712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596782.113310:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964819712:12345-0@lo:400:kworker.0 Request processed in 37us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596782.113316:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789596782.113358:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964820224 00000100:00100000:0.0:1789596782.113362:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964820224 00000100:00100000:0.0:1789596782.113391:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964819840 00000100:00100000:0.0:1789596782.113394:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964819840 00000100:00100000:0.0:1789596782.113405:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964819968 00000100:00100000:0.0:1789596782.113407:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964819968 00000100:00100000:0.0:1789596782.113421:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789596782.113426:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964820224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596782.113455:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964820224:12345-0@lo:400:kworker.0 Request processed in 29us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596782.113462:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789596782.113474:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789596782.113479:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964819840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596782.113509:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964819840:12345-0@lo:400:kworker.0 Request processed in 30us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596782.113522:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789596782.113536:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789596782.113542:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964819968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596782.113569:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964819968:12345-0@lo:400:kworker.0 Request processed in 28us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596782.113573:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1789596782.113697:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596782.113736:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964820352 00000100:00100000:0.0:1789596782.113741:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964820352 00000100:00100000:0.0:1789596782.115041:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789596782.115054:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964820352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596782.115123:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964820352:12345-0@lo:400:kworker.0 Request processed in 73us (1983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596782.115130:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789596782.115189:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f7495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964819712:0@lo:400:kworker.0 00000100:00100000:0.0:1789596782.115204:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f7496a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964820224:0@lo:400:kworker.0 00000100:00100000:0.0:1789596782.115243:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f7495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964819968:0@lo:400:kworker.0 00000100:00100000:0.0:1789596782.115255:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f7494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964819840:0@lo:400:kworker.0 00000100:00100000:0.0:1789596782.115265:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f7495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964820352:0@lo:400:kworker.0 00000100:00080000:2.0:1789596782.116727:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789596782.491484:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596782.619216:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964820480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789596782.621254:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596782.621378:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964820480 00000100:00100000:1.0:1789596782.621387:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964820480 00000100:00100000:1.0:1789596782.621451:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789596782.621462:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964820480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789596782.621504:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789596782.621569:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa436300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964820480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596782.621577:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789596782.621731:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964820480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596782.874117:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596782.874301:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944891264 00000100:00100000:0.0:1789596782.874312:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944891264 00000100:00100000:0.0:1789596782.874398:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 138 00000100:00100000:0.0:1789596782.874408:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:11335:x1876527944891264:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789596782.874428:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596782.874456:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d82b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f37 expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.874524:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d82be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.874541:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d82be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.874553:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d82be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.874568:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.874575:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.874582:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.874923:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d82be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.874933:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d82be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.874940:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d82be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.874947:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596782.874952:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d82be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.874971:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d82be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.874984:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea800) 00010000:00010000:0.0:1789596782.874987:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596782.874994:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d82be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.875001:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d82be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.875015:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.875190:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.875197:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.875202:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596782.875205:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.875213:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.875221:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ea8d55e5500) 00010000:00010000:0.0:1789596782.875224:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596782.875227:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.875243:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.875280:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d82b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f37 expref: 15 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.875291:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea800) 00010000:00010000:0.0:1789596782.875293:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596782.875297:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d82b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f37 expref: 15 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.875308:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0031000, rc 0) 00000100:00100000:0.0:1789596782.875388:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef765f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:11335:x1876527944891264:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 981us (1279us total) trans 0 rc 301/301 00000100:00100000:0.0:1789596782.875397:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 138 00000100:00080000:2.0:1789596782.875645:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596782.891754:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596782.894947:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944891520 00000100:00100000:3.0:1789596782.894964:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944891520 00000100:00100000:3.0:1789596782.895083:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 139 00000100:00100000:3.0:1789596782.895094:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:11335:x1876527944891520:12345-192.168.202.44@tcp:36:lfs.0 00010000:00010000:3.0:1789596782.895152:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596782.895179:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d7c43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d77 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596782.895198:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea800) 00010000:00010000:3.0:1789596782.895209:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596782.895468:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d82cc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596782.895482:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d82cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596782.895502:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d82cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596782.895515:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d82d3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596782.895523:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d82d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596782.895529:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d82d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596782.896752:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789596782.896767:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d82cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596782.896775:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d82cc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596782.896782:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d82cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596782.896788:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596782.896792:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d82cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596782.896800:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d82cc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596782.896812:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8d1438400) 00010000:00010000:3.0:1789596782.896856:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596782.896868:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d82cc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596782.896874:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d82cc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789596782.896893:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c5950684 reply state 0000000083a0ce02 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d82d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596782.896902:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789596782.896998:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa435f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+15:11335:x1876527944891520:12345-192.168.202.44@tcp:36:lfs.0 Request processed in 1903us (5411us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789596782.897006:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 139 00010000:00010000:0.0:1789596782.909042:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d82d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.909060:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d82d3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.909069:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d82d3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.909075:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596782.909088:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d82d3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.909096:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d82d3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.909125:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ea8d1438900) 00010000:00010000:0.0:1789596782.909128:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596782.909133:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d82d3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596782.909139:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d82d3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596783.043799:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596783.044210:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944891648 00000100:00100000:3.0:1789596783.044222:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944891648 00000100:00100000:3.0:1789596783.048360:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 140 00000100:00100000:3.0:1789596783.048384:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:11343:x1876527944891648:12345-192.168.202.44@tcp:101:lctl.0 00010000:00010000:3.0:1789596783.048411:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596783.048439:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d82da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f3e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.048524:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d82e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.048542:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d82e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.048557:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d82e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596783.048595:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789596783.048614:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789596783.048644:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d82e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.048670:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d82da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f3e expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.048688:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d82e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f3e expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.048697:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8d1438400) 00010000:00010000:3.0:1789596783.048700:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789596783.048703:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88c00, rc 0) 00000100:00100000:3.0:1789596783.048782:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa434700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+15:11343:x1876527944891648:12345-192.168.202.44@tcp:101:lctl.0 Request processed in 407us (4996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596783.048789:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 140 00000100:00100000:2.0:1789596783.173679:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596783.175208:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944891776 00000100:00100000:0.0:1789596783.175223:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944891776 00000100:00100000:0.0:1789596783.175309:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 141 00000100:00100000:0.0:1789596783.175321:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+15:11349:x1876527944891776:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:0.0:1789596783.175350:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596783.175374:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d82e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.175442:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.175468:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.175481:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.175497:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d82f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.175506:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d82f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.175528:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d82f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.175917:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d82fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.175928:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d82fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.175936:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d82fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596783.175965:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789596783.175969:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789596783.175988:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d82fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.176000:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.176007:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.176014:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.176019:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596783.176024:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.176031:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.176052:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8d1438400) 00010000:00010000:0.0:1789596783.176056:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596783.176060:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.176067:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d82ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.176155:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d82f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.176163:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d82f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.176169:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d82f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.176174:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596783.176178:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d82f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.176184:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d82f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.176193:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ea8d55e5500) 00010000:00010000:0.0:1789596783.176195:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596783.176198:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d82f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.176204:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d82f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.176374:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d82e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f45 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.176393:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d82fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f45 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.176400:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:0.0:1789596783.176403:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789596783.176405:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0031600, rc 0) 00000100:00100000:0.0:1789596783.176535:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef645880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:11349:x1876527944891776:12345-192.168.202.44@tcp:101:bash.0 Request processed in 1215us (2864us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596783.176543:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 141 00000100:00100000:0.0:1789596783.185684:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596783.190747:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944892032 00000100:00100000:1.0:1789596783.190761:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944892032 00000100:00100000:1.0:1789596783.190855:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 142 00000100:00100000:1.0:1789596783.190865:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+16:11349:x1876527944892032:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:1.0:1789596783.190886:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596783.190905:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8304 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f4c expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.191032:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d830b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.191047:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d830b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.191058:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d830b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.191241:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8312 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.191251:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8312 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.191324:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8312 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789596783.193947:0:10902:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789596783.196996:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8319 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.197021:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.197036:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8319 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.198852:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d830b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.198870:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d830b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.198878:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d830b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.198884:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a33200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596783.198889:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d830b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.198897:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d830b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.198912:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:1.0:1789596783.198915:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596783.198920:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d830b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.198948:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d830b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789596783.198967:0:10902:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037e99e6e reply state 000000006c4cafed transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8312 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596783.198976:0:10902:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789596783.199032:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8304 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f4c expref: 19 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.199049:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f4c expref: 18 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.199056:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8c36d5300) 00010000:00010000:1.0:1789596783.199059:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789596783.199061:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32200, rc 0) 00000100:00100000:1.0:1789596783.200799:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:11349:x1876527944892032:12345-192.168.202.44@tcp:101:bash.0 Request processed in 9925us (15114us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1789596783.200811:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 142 00010000:00010000:2.0:1789596783.213973:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8312 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.213992:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8312 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.214000:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8312 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.214007:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a33a00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596783.214012:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8312 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.214021:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8312 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.214038:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ea8c36d5600) 00010000:00010000:2.0:1789596783.214041:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596783.214062:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8312 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.214070:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8312 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596783.217084:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596783.217395:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944892160 00000100:00100000:2.0:1789596783.217406:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944892160 00000100:00100000:2.0:1789596783.217484:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 47 00000100:00100000:2.0:1789596783.217495:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2354:x1876527944892160:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:2.0:1789596783.217513:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596783.217534:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8327 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f53 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789596783.217561:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789596783.217581:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=368s v=(0 0) 00010000:00010000:2.0:1789596783.217585:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596783.217595:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8327 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f53 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.217615:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8327 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f53 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.217629:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426c00, rc 0) 00000100:00100000:2.0:1789596783.217698:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2354:x1876527944892160:12345-192.168.202.44@tcp:101:bash.0 Request processed in 205us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596783.217705:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 47 00000100:00080000:0.0:1789596783.217900:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789596783.221812:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596783.221935:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944892288 00000100:00100000:0.0:1789596783.221946:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944892288 00000100:00100000:0.0:1789596783.222006:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 48 00000100:00100000:0.0:1789596783.222029:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:11349:x1876527944892288:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:0.0:1789596783.222048:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596783.222068:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d832e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f5a expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.222099:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8327 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f53 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.222127:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596783.222132:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596783.222138:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d832e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f5a expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.222174:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8327 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f53 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.222189:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8327 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f53 expref: 7 pid: 6692 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596783.222206:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa655500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1876527964820608:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789596783.222324:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ef49dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789596783.226231:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596783.226373:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944892416 00000100:00100000:2.0:1789596783.226396:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944892416 00010000:00010000:2.0:1789596783.226438:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8327 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f53 expref: 8 pid: 6692 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596783.226484:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 60 00000100:00100000:2.0:1789596783.226494:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5048a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2353:x1876527944892416:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596783.226509:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596783.226531:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8327 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f53 expref: 8 pid: 6692 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.226545:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8327 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f53 expref: 8 pid: 6692 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.226570:0:7644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596783.226574:0:7644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596783.226583:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d832e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f5a expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.226593:0:7644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d832e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f5a expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.226643:0:7644:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d832e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f5a expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596783.226658:0:7644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef647480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7644:1876527964820736:192.168.202.44@tcp:105: 00000100:00100000:2.0:1789596783.226796:0:7644:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6912480 going to sleep for 11 seconds 00010000:00010000:0.0:1789596783.228264:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8327 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f53 expref: 8 pid: 6692 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596783.228287:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa655500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1876527964820608:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596783.228323:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d832e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f5a expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.228348:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030e00, rc 0) 00000100:00100000:0.0:1789596783.228399:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa434e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:11349:x1876527944892288:12345-192.168.202.44@tcp:101:bash.0 Request processed in 6384us (6596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596783.228423:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 48 00000100:00100000:2.0:1789596783.232547:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596783.232784:0:7644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef647480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7644:1876527964820736:192.168.202.44@tcp:105: 00010000:00010000:3.0:1789596783.232808:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596783.232903:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5048a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2353:x1876527944892416:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 6411us (6681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596783.232915:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 60 00000100:00100000:1.0:1789596783.233208:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944892672 00000100:00100000:1.0:1789596783.233217:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944892672 00000100:00100000:1.0:1789596783.233275:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 36 00000100:00100000:1.0:1789596783.233285:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:11349:x1876527944892672:12345-192.168.202.44@tcp:35:bash.0 00000100:00100000:1.0:1789596783.233675:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:11349:x1876527944892672:12345-192.168.202.44@tcp:35:bash.0 Request processed in 390us (1139us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789596783.233684:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 36 00000100:00100000:2.0:1789596783.310305:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596783.310416:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944892928 00000100:00100000:3.0:1789596783.310428:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944892928 00000100:00100000:3.0:1789596783.310498:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 143 00000100:00100000:3.0:1789596783.310509:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:11359:x1876527944892928:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:3.0:1789596783.310536:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596783.310573:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8335 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f61 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596783.310683:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789596783.310810:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8335 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f61 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.310872:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8d1438400) 00010000:00010000:3.0:1789596783.310875:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789596783.310882:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8335 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f61 expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.310896:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88600, rc 0) 00000100:00100000:3.0:1789596783.310958:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef646d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:11359:x1876527944892928:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 451us (665us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1789596783.310965:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 143 00000100:00100000:3.0:1789596783.313391:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596783.313532:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944893184 00000100:00100000:1.0:1789596783.313543:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944893184 00000100:00100000:1.0:1789596783.313733:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 37 00000100:00100000:1.0:1789596783.313744:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:11359:x1876527944893184:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:1.0:1789596783.314032:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:11359:x1876527944893184:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 279us (638us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1789596783.314040:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 37 00000100:00100000:2.0:1789596783.391753:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596783.391849:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944893312 00000100:00100000:3.0:1789596783.391860:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944893312 00000100:00100000:3.0:1789596783.391918:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 144 00000100:00100000:3.0:1789596783.391927:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:11365:x1876527944893312:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:3.0:1789596783.391955:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596783.391975:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8343 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f68 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.392040:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d834a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.392085:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d834a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.392097:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d834a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596783.392133:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789596783.392136:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789596783.392152:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d834a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.392176:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8343 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f68 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.392194:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d834a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f68 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.392204:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:3.0:1789596783.392207:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789596783.392211:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89c00, rc 0) 00000100:00100000:3.0:1789596783.392599:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef644000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:11365:x1876527944893312:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 671us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596783.392607:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 144 00000100:00100000:2.0:1789596783.402630:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596783.406496:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944893568 00000100:00100000:3.0:1789596783.406517:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944893568 00000100:00100000:3.0:1789596783.406608:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 145 00000100:00100000:3.0:1789596783.406620:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:11365:x1876527944893568:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:3.0:1789596783.406650:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596783.406685:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8351 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f6f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.406778:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d8358 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.406793:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d8358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.406805:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d8358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596783.406834:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789596783.406966:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8351 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f6f expref: 25 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.406987:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d8358 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f6f expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.406996:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8c36d5300) 00010000:00010000:3.0:1789596783.406999:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596783.407003:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89200, rc 0) 00000100:00100000:3.0:1789596783.407085:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef646a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+24:11365:x1876527944893568:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 467us (4465us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1789596783.407093:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 145 00000100:00100000:0.0:1789596783.412616:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596783.412665:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596783.412803:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944893952 00000100:00100000:2.0:1789596783.412846:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944893952 00000100:00100000:2.0:1789596783.412916:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 10 00000100:00100000:2.0:1789596783.412927:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa654000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+24:2353:x1876527944893952:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596783.412942:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596783.412967:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d8358 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f6f expref: 24 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.412986:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8c36d5300) 00010000:00010000:2.0:1789596783.412991:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596783.413040:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa654000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:2353:x1876527944893952:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 114us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596783.413047:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 10 00000100:00100000:3.0:1789596783.413481:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944893824 00000100:00100000:3.0:1789596783.413487:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944893824 00000100:00100000:3.0:1789596783.413519:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 146 00000100:00100000:3.0:1789596783.413527:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:11365:x1876527944893824:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:3.0:1789596783.413565:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596783.413581:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d8366 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f76 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.413685:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d836d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.413700:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d836d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.413712:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d836d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596783.413725:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789596783.413883:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d8366 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f76 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.413899:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d836d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f76 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.413906:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8c36d5300) 00010000:00010000:3.0:1789596783.413909:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789596783.413911:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89600, rc 0) 00000100:00100000:3.0:1789596783.413951:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa655500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+25:11365:x1876527944893824:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 425us (1346us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1789596783.413958:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 146 00000100:00100000:0.0:1789596783.422689:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596783.422872:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944894080 00000100:00100000:2.0:1789596783.422883:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944894080 00000100:00100000:2.0:1789596783.422948:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 49 00000100:00100000:2.0:1789596783.422958:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2354:x1876527944894080:12345-192.168.202.44@tcp:1:lfs.0 00010000:00010000:2.0:1789596783.423008:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d837b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.423029:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d832e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f5a expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.423057:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596783.423062:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789596783.423067:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d837b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.423119:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d832e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f5a expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.423135:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d832e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f5a expref: 6 pid: 6693 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596783.423151:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef647b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1876527964820864:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789596783.423785:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6912000 going to sleep for 11 seconds 00000100:00100000:2.0:1789596783.427809:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596783.428744:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944894208 00000100:00100000:1.0:1789596783.428756:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944894208 00002000:00100000:1.0:1789596783.428806:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9ea8ef647480 x1876527944894208/t0(0) o4->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:664/0 lens 504/0 e 0 to 0 dl 1789596794 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789596783.428844:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8ef647480 with x1876527944894208 ext(0->12) 00010000:00010000:1.0:1789596783.428852:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d832e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f5a expref: 7 pid: 6693 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.428866:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d832e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f5a expref: 7 pid: 6693 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789596783.428871:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ea8ef647480 00000100:00100000:1.0:1789596783.428894:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2 00000100:00100000:1.0:1789596783.428901:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2353:x1876527944894208:12345-192.168.202.44@tcp:4:lfs.0 00000100:00100000:1.0:1789596783.429351:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef647480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:2353:x1876527944894208:12345-192.168.202.44@tcp:4:lfs.0 Request processed in 448us (1549us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789596783.429359:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2 00002000:00100000:1.0:1789596783.429366:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9ea8ef647480 x1876527944894208/t4294967305(0) o4->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:664/0 lens 504/448 e 0 to 0 dl 1789596794 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789596783.429381:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8ef647480 with x1876527944894208 ext(0->12) 00010000:00010000:1.0:1789596783.429385:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d832e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f5a expref: 9 pid: 6693 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.429394:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d832e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f5a expref: 9 pid: 6693 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789596783.429399:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ea8ef647480 00000100:00100000:0.0:1789596783.432837:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef647b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1876527964820864:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596783.432871:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d837b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596783.433505:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596783.433586:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944894336 00000100:00100000:2.0:1789596783.433593:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944894336 00010000:00010000:2.0:1789596783.433643:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d832e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f5a expref: 9 pid: 6693 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596783.433682:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 61 00000100:00100000:2.0:1789596783.433690:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5048700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:2352:x1876527944894336:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596783.433705:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789596783.433723:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789596783.433725:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789596783 00002000:00010000:2.0:1789596783.433739:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789596783 00002000:00010000:2.0:1789596783.433740:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789596783 00010000:00010000:2.0:1789596783.433746:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d832e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f5a expref: 9 pid: 6693 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.433755:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d832e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f5a expref: 9 pid: 6693 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.433774:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0b5ce39/0x8973ae90b38d832e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f5a expref: 9 pid: 6693 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.433789:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789596783.433793:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789596783.433797:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d837b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.433805:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d837b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.433861:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596783.433902:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5048700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2352:x1876527944894336:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 213us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596783.433907:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 61 00010000:00010000:0.0:1789596783.434347:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d837b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.434359:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d837b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.434388:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d837b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.434396:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d837b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.434405:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d837b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.434412:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596783.434417:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d837b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.434434:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d837b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.434447:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d837b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.434454:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d837b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596783.434554:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2354:x1876527944894080:12345-192.168.202.44@tcp:1:lfs.0 Request processed in 11597us (11875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596783.434563:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 49 00000100:00100000:3.0:1789596783.441366:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596783.441450:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944894592 00000100:00100000:0.0:1789596783.441461:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944894592 00000100:00100000:0.0:1789596783.441530:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 38 00000100:00100000:0.0:1789596783.441541:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3553450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+25:11365:x1876527944894592:12345-192.168.202.44@tcp:35:lfs.0 00000004:00010000:0.0:1789596783.441606:0:5844:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d836d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f76 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789596783.441926:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1789596783.441974:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1789596783.443506:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1789596783.443589:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8382 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.443608:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8319 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f4c expref: 29 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.443625:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8382 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.443745:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8319 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f4c expref: 29 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.443765:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8319 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f4c expref: 29 pid: 10902 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596783.443782:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa655180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1876527964820992:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789596783.444022:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ef49dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789596783.451531:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596783.451862:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944894720 00000100:00100000:2.0:1789596783.451873:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944894720 00010000:00010000:2.0:1789596783.451917:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8319 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f4c expref: 30 pid: 10902 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596783.451976:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 62 00000100:00100000:2.0:1789596783.451986:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5048e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+30:2353:x1876527944894720:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596783.452001:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596783.452009:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8319 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f4c expref: 30 pid: 10902 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.452023:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8319 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f4c expref: 30 pid: 10902 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.452045:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8c36d5300) 00010000:00010000:2.0:1789596783.452051:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8382 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.452060:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8382 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.452068:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8382 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.452099:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596783.452168:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5048e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+30:2353:x1876527944894720:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 182us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596783.452176:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 62 00010000:00010000:0.0:1789596783.457174:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8319 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f4c expref: 29 pid: 10902 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596783.457203:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa655180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5844:1876527964820992:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596783.457227:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8382 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.457238:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8382 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.457242:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8382 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789596783.457390:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1789596783.457545:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1789596783.457628:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa655180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1876527964821120:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789596783.457706:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596783.457743:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ef49d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596783.457770:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964821120 00000100:00100000:1.0:1789596783.457777:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964821120 00000100:00100000:1.0:1789596783.457930:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789596783.457940:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1876527964821120:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789596783.458028:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1876527964821120:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 90us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596783.458036:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789596783.458458:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa655180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1876527964821120:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789596783.459092:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1789596783.459172:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c504b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1876527964821248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789596783.459218:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596783.460096:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff4b0180 going to sleep for 11 seconds 00000100:00100000:0.0:1789596783.460179:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964821248 00000100:00100000:0.0:1789596783.460187:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964821248 00000100:00100000:0.0:1789596783.460230:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789596783.460238:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1876527964821248:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789596783.460766:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1876527964821248:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 526us (1544us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789596783.460776:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789596783.460871:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c504b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5844:1876527964821248:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789596783.460939:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1789596783.461001:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8382 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.461012:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8382 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.461020:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8382 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.461027:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596783.461032:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8382 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.461040:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8382 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.461055:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8c36d5300) 00010000:00010000:2.0:1789596783.461058:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789596783.461187:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8382 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.461195:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8382 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789596783.461557:0:5844:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789596783.461745:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1789596783.461757:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 368425939794ns, next at 369425937482ns, rc = 0 00000001:00080000:2.0:1789596783.461764:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1789596783.461798:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8c36d5300) 00010000:00010000:2.0:1789596783.461802:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789596783.461809:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d836d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f76 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596783.462223:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3553450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+32:11365:x1876527944894592:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 20682us (20865us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1789596783.462232:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 38 00000020:00080000:2.0:1789596783.462237:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789596783.465346:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596783.465431:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944894848 00000100:00100000:3.0:1789596783.465442:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944894848 00000100:00100000:3.0:1789596783.465500:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 147 00000100:00100000:3.0:1789596783.465511:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+32:11365:x1876527944894848:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:3.0:1789596783.465537:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596783.465566:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d8389 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f7d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.465656:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d8389 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f7d expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.465674:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d8389 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f7d expref: 33 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.465695:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:3.0:1789596783.465698:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789596783.465702:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89e00, rc 0) 00000100:00100000:3.0:1789596783.465764:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa436d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+33:11365:x1876527944894848:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 255us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596783.465771:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 147 00000100:00100000:2.0:1789596783.474058:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596783.474143:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944895104 00000100:00100000:1.0:1789596783.474153:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944895104 00000100:00100000:1.0:1789596783.474261:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 39 00000100:00100000:1.0:1789596783.474272:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+33:11365:x1876527944895104:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:1.0:1789596783.474525:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef647100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+34:11365:x1876527944895104:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 254us (476us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1789596783.474533:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 39 00010000:00010000:3.0:1789596783.520176:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596783.551660:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596783.551855:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944895360 00000100:00100000:3.0:1789596783.551867:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944895360 00000100:00100000:3.0:1789596783.552004:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 148 00000100:00100000:3.0:1789596783.552015:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+34:11375:x1876527944895360:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:3.0:1789596783.552054:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596783.553393:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8390 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f84 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596783.553500:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789596783.553630:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8390 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f84 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.553646:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8d1438400) 00010000:00010000:3.0:1789596783.553649:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789596783.553655:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8390 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f84 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596783.553671:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88600, rc 0) 00000100:00100000:3.0:1789596783.553748:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef647b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+35:11375:x1876527944895360:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 1734us (2098us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1789596783.553757:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 148 00000100:00100000:3.0:1789596783.557225:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596783.557498:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944895488 00000100:00100000:2.0:1789596783.557508:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944895488 00000100:00100000:2.0:1789596783.557559:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 149 00000100:00100000:2.0:1789596783.557567:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c504aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+35:11375:x1876527944895488:12345-192.168.202.44@tcp:34:lfs.0 00010000:00010000:2.0:1789596783.557741:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d839e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.557755:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d839e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.557764:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d839e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.557775:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d83a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.557779:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d83a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.557783:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d83a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.557881:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d83ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.557899:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d83ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.557905:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d83ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596783.557945:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d83ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.557955:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d839e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.557960:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d839e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.557965:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d839e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.557969:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596783.557972:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d839e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.557976:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d839e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.557984:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:2.0:1789596783.557986:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596783.557990:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d839e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.557994:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d839e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.558008:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d83a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.558012:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d83a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.558016:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d83a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.558030:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427a00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596783.558033:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d83a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.558039:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d83a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.558048:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ea8e0eea600) 00010000:00010000:2.0:1789596783.558050:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596783.558053:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d83a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.558068:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d83a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.559233:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d83ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.559239:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d83ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.559244:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d83ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.559384:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596783.559387:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d83ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.559392:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d83ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.559403:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:2.0:1789596783.559405:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596783.559407:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d83ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.559411:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d83ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596783.559500:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c504aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+35:11375:x1876527944895488:12345-192.168.202.44@tcp:34:lfs.0 Request processed in 1930us (2280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596783.559507:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 149 00000100:00100000:2.0:1789596783.564504:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596783.564572:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944895744 00000100:00100000:0.0:1789596783.564581:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944895744 00000100:00100000:0.0:1789596783.564650:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 40 00000100:00100000:0.0:1789596783.564661:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+35:11375:x1876527944895744:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:0.0:1789596783.564908:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+36:11375:x1876527944895744:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 249us (412us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789596783.564914:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 40 00000100:00100000:0.0:1789596783.600724:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596783.600867:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944896000 00000100:00100000:1.0:1789596783.600878:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944896000 00000100:00100000:1.0:1789596783.600954:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 150 00000100:00100000:1.0:1789596783.600964:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+36:11378:x1876527944896000:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:1.0:1789596783.600990:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596783.601012:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d83b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f8b expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601109:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d83ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601126:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d83ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601138:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d83ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601154:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d83c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601162:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d83c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601170:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d83c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601307:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d83c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601315:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d83c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601322:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d83c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596783.601353:0:10902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789596783.601454:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d83ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601461:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d83ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601467:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d83ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601473:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a33200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596783.601477:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d83ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601485:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d83ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601497:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:1.0:1789596783.601500:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596783.601504:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d83ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601509:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d83ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601523:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d83c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601528:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d83c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601544:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d83c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601549:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596783.601552:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d83c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601558:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d83c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601565:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ea8c36d5e00) 00010000:00010000:1.0:1789596783.601568:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596783.601571:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d83c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601576:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d83c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601620:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d83b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f8b expref: 39 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601635:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d83c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f8b expref: 38 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596783.601642:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:1.0:1789596783.601644:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789596783.601647:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a33600, rc 0) 00000100:00100000:1.0:1789596783.601716:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+38:11378:x1876527944896000:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 753us (1002us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1789596783.601733:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 150 00000100:00100000:3.0:1789596783.610966:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596783.611044:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944896128 00000100:00100000:0.0:1789596783.611055:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944896128 00000100:00100000:0.0:1789596783.611124:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 151 00000100:00100000:0.0:1789596783.611136:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c504bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+38:11378:x1876527944896128:12345-192.168.202.44@tcp:54:lfs.0 00010000:00010000:0.0:1789596783.611207:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d83d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.611225:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d83d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.611238:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d83d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.611295:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d83d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.611303:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d83d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.611310:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d83d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.611316:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596783.611321:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d83d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.611340:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d83d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.611353:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:0.0:1789596783.611357:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789596783.611362:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d83d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.611368:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d83d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596783.611441:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c504bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+38:11378:x1876527944896128:12345-192.168.202.44@tcp:54:lfs.0 Request processed in 306us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596783.611448:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 151 00000100:00100000:2.0:1789596783.614492:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596783.614540:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944896384 00000100:00100000:0.0:1789596783.614551:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944896384 00000100:00100000:0.0:1789596783.614615:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 41 00000100:00100000:0.0:1789596783.614643:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+38:11378:x1876527944896384:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:0.0:1789596783.616451:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+39:11378:x1876527944896384:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 1811us (1956us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789596783.616463:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 41 00000100:00100000:3.0:1789596783.892893:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596783.892997:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944896640 00000100:00100000:0.0:1789596783.893008:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944896640 00000100:00100000:0.0:1789596783.893085:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 152 00000100:00100000:0.0:1789596783.893095:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+39:11409:x1876527944896640:12345-192.168.202.44@tcp:101:cat.0 00010000:00010000:0.0:1789596783.893120:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596783.893140:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d83dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f92 expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.893231:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d83e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.893243:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d83e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.893251:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d83e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596783.893259:0:10902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789596783.893427:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d83dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f92 expref: 42 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.893449:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d83e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f92 expref: 41 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.893482:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:0.0:1789596783.893485:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596783.893490:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030c00, rc 0) 00000100:00100000:0.0:1789596783.893747:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+41:11409:x1876527944896640:12345-192.168.202.44@tcp:101:cat.0 Request processed in 652us (863us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1789596783.893755:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 152 00000100:00100000:1.0:1789596783.897811:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596783.898025:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596783.898568:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944897024 00000100:00100000:3.0:1789596783.898580:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944897024 00000100:00100000:3.0:1789596783.898641:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 42 00000100:00100000:3.0:1789596783.898651:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+41:11409:x1876527944897024:12345-192.168.202.44@tcp:35:cat.0 00000100:00100000:3.0:1789596783.898946:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+42:11409:x1876527944897024:12345-192.168.202.44@tcp:35:cat.0 Request processed in 295us (920us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789596783.898970:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 42 00000100:00100000:2.0:1789596783.903360:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944896768 00000100:00100000:2.0:1789596783.903377:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944896768 00000100:00100000:2.0:1789596783.903468:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 11 00000100:00100000:2.0:1789596783.903479:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa436680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+42:2354:x1876527944896768:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596783.903499:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596783.903520:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d83e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f92 expref: 42 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596783.903556:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:2.0:1789596783.903559:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596783.903636:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa436680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+41:2354:x1876527944896768:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 158us (5837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596783.903643:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 11 00000100:00100000:1.0:1789596783.989995:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596783.990105:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944897280 00000100:00100000:0.0:1789596783.990117:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944897280 00000100:00100000:0.0:1789596783.990180:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 153 00000100:00100000:0.0:1789596783.990191:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+41:11415:x1876527944897280:12345-192.168.202.44@tcp:101:dd.0 00010000:00010000:0.0:1789596783.990217:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596783.990220:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789596783.990247:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d834a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f68 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.990264:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:0.0:1789596783.990269:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596783.990282:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d83f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344f99 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.990391:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d83f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.990404:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d83c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f8b expref: 41 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.990431:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d83f9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.990464:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d83c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f8b expref: 41 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596783.990477:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d83c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f8b expref: 41 pid: 10902 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596783.990491:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa654700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1876527964821376:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789596783.990602:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ef49d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789596783.993362:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa654700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1876527964821376:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596783.993394:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d83f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596783.999951:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596784.010729:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944897408 00000100:00100000:2.0:1789596784.010748:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944897408 00010000:00010000:2.0:1789596784.010846:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d83c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f8b expref: 42 pid: 10902 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596784.010893:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 63 00000100:00100000:2.0:1789596784.010908:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa436a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+42:2354:x1876527944897408:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596784.010925:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596784.010933:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d83c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f8b expref: 42 pid: 10902 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.010947:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d83c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f8b expref: 42 pid: 10902 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.010972:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d83c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f8b expref: 42 pid: 10902 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.010989:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:2.0:1789596784.010994:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d83f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.011035:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d83f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.011044:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d83f9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.011086:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596784.011149:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa436a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+41:2354:x1876527944897408:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 246us (11208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596784.011156:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 63 00000100:00080000:0.0:1789596784.011430:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789596784.012279:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d83f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.012302:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d83f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596784.012334:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789596784.012503:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d83f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f99 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.012525:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d83f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f99 expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.012534:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:1.0:1789596784.012536:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789596784.012539:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030e00, rc 0) 00000100:00100000:1.0:1789596784.012603:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa435500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+41:11415:x1876527944897280:12345-192.168.202.44@tcp:101:dd.0 Request processed in 22401us (22604us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789596784.012611:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 153 00000100:00100000:1.0:1789596784.015894:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596784.015992:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944897664 00000100:00100000:0.0:1789596784.016002:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944897664 00000100:00100000:0.0:1789596784.016069:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 154 00000100:00100000:0.0:1789596784.016078:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+41:11415:x1876527944897664:12345-192.168.202.44@tcp:36:dd.0 00010000:00010000:0.0:1789596784.016332:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8407 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.016348:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8407 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.016358:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8407 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789596784.016422:0:10902:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1789596784.016450:0:10902:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f21e54c5 reply state 00000000c8856650 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8407 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596784.016459:0:10902:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789596784.016730:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+44:11415:x1876527944897664:12345-192.168.202.44@tcp:36:dd.0 Request processed in 651us (843us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789596784.016737:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 154 00000020:00080000:0.0:1789596784.016742:0:10902:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789596784.025074:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8407 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.025094:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8407 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.025102:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8407 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.025108:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596784.025112:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8407 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.025120:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8407 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.025136:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:0.0:1789596784.025140:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596784.025144:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8407 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.025151:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8407 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596784.448977:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596784.449181:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944897792 00000100:00100000:2.0:1789596784.449192:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944897792 00000100:00100000:2.0:1789596784.449253:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 155 00000100:00100000:2.0:1789596784.449264:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+43:11429:x1876527944897792:12345-192.168.202.44@tcp:101:stat.0 00010000:00010000:2.0:1789596784.449366:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596784.449394:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d840e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344fa0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.449462:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8415 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.449477:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8415 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.449490:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8415 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.449504:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d841c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.449530:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d841c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.449537:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d841c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.449628:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d8423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.449639:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d83f9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f99 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.449647:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d8423 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.449681:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d83f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f99 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.449695:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d83f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f99 expref: 44 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596784.449709:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef52b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1876527964821504:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789596784.452676:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6912840 going to sleep for 11 seconds 00000100:00100000:3.0:1789596784.461808:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef52b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1876527964821504:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789596784.461868:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d8423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596784.462657:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596784.462963:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944898048 00000100:00100000:3.0:1789596784.462971:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944898048 00000100:00100000:3.0:1789596784.463138:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 43 00000100:00100000:3.0:1789596784.463150:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+45:5589:x1876527944898048:12345-192.168.202.44@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789596784.463615:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+46:5589:x1876527944898048:12345-192.168.202.44@tcp:35:ldlm_bl.0 Request processed in 466us (960us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1789596784.463623:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 43 00000100:00100000:2.0:1789596784.468575:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596784.468707:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944898176 00000100:00100000:3.0:1789596784.468717:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944898176 00010000:00010000:3.0:1789596784.468761:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d83f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f99 expref: 46 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596784.468881:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 64 00000100:00100000:3.0:1789596784.468892:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c8282c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+46:2354:x1876527944898176:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596784.468908:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596784.468916:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d83f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f99 expref: 46 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.468929:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d83f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f99 expref: 46 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.468974:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d83f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f99 expref: 46 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.468993:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:3.0:1789596784.468998:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d8423 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.469008:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d8423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.469016:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d8423 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.469120:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596784.469186:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c8282c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+45:2354:x1876527944898176:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 295us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596784.469194:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 64 00010000:00010000:2.0:1789596784.469662:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d8423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.469671:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d8423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596784.469730:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789596784.469735:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789596784.469761:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d8423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.469775:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d8423 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.469784:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8415 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.469791:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8415 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.469798:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8415 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.469804:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596784.469809:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8415 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.469852:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8415 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.469864:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:2.0:1789596784.469867:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596784.469870:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8415 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.469877:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8415 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.469901:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d841c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.469908:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d841c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.469914:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d841c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.469920:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596784.469923:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d841c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.469928:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d841c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.469936:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ea8e0eea600) 00010000:00010000:2.0:1789596784.469939:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596784.469942:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d841c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.469946:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426c00/0x8973ae90b38d841c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.469986:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d840e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fa0 expref: 45 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.470002:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d8423 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fa0 expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.470020:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:2.0:1789596784.470023:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596784.470026:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426400, rc 0) 00000100:00100000:2.0:1789596784.470081:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+44:11429:x1876527944897792:12345-192.168.202.44@tcp:101:stat.0 Request processed in 20818us (21114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596784.470089:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 155 00000100:00100000:2.0:1789596784.529964:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596784.530048:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944898432 00000100:00100000:3.0:1789596784.530059:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944898432 00000100:00100000:3.0:1789596784.530126:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 156 00000100:00100000:3.0:1789596784.530137:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+44:11435:x1876527944898432:12345-192.168.202.44@tcp:36:truncate.0 00010000:00010000:3.0:1789596784.530200:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596784.530225:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d8423 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fa0 expref: 44 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.530245:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:3.0:1789596784.530249:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596784.530497:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d842a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.530513:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d842a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.530523:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d842a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789596784.530574:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1789596784.531158:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005b3989c reply state 00000000ce298252 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d842a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596784.531169:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789596784.531281:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+46:11435:x1876527944898432:12345-192.168.202.44@tcp:36:truncate.0 Request processed in 1144us (1322us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1789596784.531290:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 156 00000020:00080000:3.0:1789596784.531295:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789596784.533416:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d842a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.533434:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d842a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.533443:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d842a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.533450:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596784.533455:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d842a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.533463:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d842a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.533479:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:2.0:1789596784.533483:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596784.533488:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d842a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.533494:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d842a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.539474:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596784.640680:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596784.640792:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944898560 00000100:00100000:1.0:1789596784.640848:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944898560 00000100:00100000:1.0:1789596784.640910:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 157 00000100:00100000:1.0:1789596784.640920:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+45:11449:x1876527944898560:12345-192.168.202.44@tcp:101:stat.0 00010000:00010000:1.0:1789596784.640945:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596784.640964:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8431 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344fa7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641015:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8438 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641027:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8438 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641039:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8438 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641053:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d843f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641060:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d843f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641066:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d843f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641139:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8446 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641145:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641149:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596784.641184:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789596784.641187:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789596784.641204:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641212:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8446 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641218:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8438 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641222:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8438 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641227:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8438 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641230:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596784.641233:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8438 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641238:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8438 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641246:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:1.0:1789596784.641248:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596784.641252:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8438 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641255:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8438 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641271:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d843f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641275:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d843f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641279:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d843f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641282:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a33400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596784.641283:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d843f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641287:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d843f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641291:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ea8c36d5e00) 00010000:00010000:1.0:1789596784.641292:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596784.641294:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d843f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641297:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d843f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641331:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8431 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fa7 expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641345:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8446 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fa7 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596784.641362:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:1.0:1789596784.641364:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789596784.641367:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32200, rc 0) 00000100:00100000:1.0:1789596784.641535:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+46:11449:x1876527944898560:12345-192.168.202.44@tcp:101:stat.0 Request processed in 616us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596784.641543:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 157 00000100:00100000:2.0:1789596784.727877:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596784.727916:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944898816 00000100:00100000:2.0:1789596784.727927:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944898816 00000100:00100000:2.0:1789596784.727980:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 158 00000100:00100000:2.0:1789596784.727991:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+46:11459:x1876527944898816:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:2.0:1789596784.728016:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596784.728037:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d844d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344fae expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596784.728155:0:10902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789596784.728510:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d844d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fae expref: 48 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.728526:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8d1438400) 00010000:00010000:2.0:1789596784.728529:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789596784.728535:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d844d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fae expref: 48 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.728548:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426e00, rc 0) 00000100:00100000:2.0:1789596784.728614:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+47:11459:x1876527944898816:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 625us (748us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1789596784.731007:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 158 00000100:00100000:3.0:1789596784.737933:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596784.738027:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944899072 00000100:00100000:0.0:1789596784.738038:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944899072 00000100:00100000:0.0:1789596784.738145:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 44 00000100:00100000:0.0:1789596784.738157:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3551050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+47:11459:x1876527944899072:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:0.0:1789596784.738399:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3551050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+48:11459:x1876527944899072:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 244us (474us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1789596784.738407:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 44 00000001:00080000:2.0:1789596784.764383:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000004:00080000:2.0:1789596784.764445:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:2.0:1789596784.764494:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000020:00080000:2.0:1789596784.764511:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ea8ff4b0780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789596784.764515:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ea8c63b9700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ea8ff4b0240 00000020:00080000:2.0:1789596784.764519:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ea8c63b9000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ea8c56e7c00 00000020:00080000:0.0:1789596784.764594:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:2.0:1789596784.764750:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964821632:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1789596784.764784:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789596784.764842:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596784.765164:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964821632 00000100:00100000:0.0:1789596784.765173:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964821632 00000100:00100000:0.0:1789596784.765288:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789596784.765297:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1876527964821632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789596784.765335:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1789596784.765369:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aab146f, atime: 0x6aab146f, ctime: 0x6aab146f, blocks: 0x1 00010000:00010000:0.0:1789596784.765378:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d82de987/0x8973ae90b38d845b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.765394:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=369s v=(0 0) 00010000:00010000:0.0:1789596784.765398:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596784.765405:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d82de987/0x8973ae90b38d845b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.765421:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d82de987/0x8973ae90b38d845b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.765445:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d82de987/0x8973ae90b38d845b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.765453:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d82de987/0x8973ae90b38d845b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.765477:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1789596784.770614:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789596784.770641:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596784.770650:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d82de987/0x8973ae90b38d845b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.770664:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030c00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:3.0:1789596784.770669:0:7643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d82de987/0x8973ae90b38d845b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.770681:0:7643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d82de987/0x8973ae90b38d845b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.770725:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d82de987/0x8973ae90b38d845b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.770733:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d82de987/0x8973ae90b38d845b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.770767:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596784.770769:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596784.770771:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596784.774527:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1876527964821632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9219us (9673us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789596784.774545:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:2.0:1789596784.775547:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ea8c5048a80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1789596784.775559:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964821632:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789596784.809652:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596784.813640:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944899328 00000100:00100000:0.0:1789596784.813658:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944899328 00000100:00100000:0.0:1789596784.813729:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 159 00000100:00100000:0.0:1789596784.813740:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:11465:x1876527944899328:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:0.0:1789596784.813768:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596784.813793:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8462 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344fb5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.813910:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8469 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.813926:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8446 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fa7 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.813936:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8469 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.813989:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8446 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fa7 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.814003:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8446 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fa7 expref: 19 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596784.814017:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa654700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1876527964821760:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789596784.814117:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ef49d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789596784.817684:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596784.817754:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944899456 00000100:00100000:3.0:1789596784.817765:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944899456 00010000:00010000:3.0:1789596784.817808:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8446 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fa7 expref: 20 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596784.817891:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 65 00000100:00100000:3.0:1789596784.817901:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:2354:x1876527944899456:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596784.817916:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596784.817924:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8446 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fa7 expref: 20 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.817940:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8446 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fa7 expref: 20 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.817963:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:3.0:1789596784.817968:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8469 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.817997:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8469 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.818005:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8469 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.818024:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596784.818084:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:2354:x1876527944899456:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 184us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596784.818091:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 65 00010000:00010000:0.0:1789596784.822567:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8446 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fa7 expref: 19 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596784.822593:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa654700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1876527964821760:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596784.822619:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8469 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.822629:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8469 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.822635:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8469 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596784.822657:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1789596784.822877:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8462 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fb5 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.822898:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8469 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fb5 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.822927:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:0.0:1789596784.822930:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789596784.822934:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030e00, rc 0) 00000100:00100000:0.0:1789596784.822997:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:11465:x1876527944899328:12345-192.168.202.44@tcp:101:bash.0 Request processed in 9259us (13355us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1789596784.823008:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 159 00000100:00100000:2.0:1789596784.825719:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596784.825810:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944899712 00000100:00100000:3.0:1789596784.825847:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944899712 00000100:00100000:3.0:1789596784.825909:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 160 00000100:00100000:3.0:1789596784.825918:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:11465:x1876527944899712:12345-192.168.202.44@tcp:36:bash.0 00010000:00010000:3.0:1789596784.826215:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8477 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.826233:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8477 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.826245:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8477 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789596784.826311:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1789596784.826348:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006107abb4 reply state 000000005d880c0e transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8477 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596784.826357:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789596784.826450:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:11465:x1876527944899712:12345-192.168.202.44@tcp:36:bash.0 Request processed in 533us (739us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1789596784.826475:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 160 00000020:00080000:3.0:1789596784.826480:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789596784.830677:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8477 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.830695:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8477 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.830702:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8477 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.830708:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596784.830713:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8477 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.830720:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8477 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.830736:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:0.0:1789596784.830739:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596784.830744:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8477 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.830749:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8477 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596784.832440:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596784.834456:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944899840 00000100:00100000:0.0:1789596784.834473:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944899840 00000100:00100000:0.0:1789596784.834531:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 161 00000100:00100000:0.0:1789596784.834542:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:11465:x1876527944899840:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:0.0:1789596784.834570:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596784.834590:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d847e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344fbc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.834671:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8485 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.834687:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8469 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fb5 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.834697:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8485 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.834732:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8469 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fb5 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.834747:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8469 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fb5 expref: 22 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596784.834761:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa654700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1876527964821888:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789596784.834883:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ef49d600 going to sleep for 11 seconds 00000100:00100000:0.0:1789596784.841198:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596784.841239:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa654700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1876527964821888:192.168.202.44@tcp:104: 00000100:00100000:3.0:1789596784.841349:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944899968 00000100:00100000:3.0:1789596784.841358:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944899968 00010000:00010000:3.0:1789596784.841396:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8469 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fb5 expref: 23 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.841479:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8485 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596784.841543:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 66 00000100:00100000:3.0:1789596784.841553:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa654e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:2353:x1876527944899968:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596784.841571:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596784.841579:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8469 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fb5 expref: 23 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.841602:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8469 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fb5 expref: 23 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.841635:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8469 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fb5 expref: 23 pid: 5842 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.841725:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:3.0:1789596784.841730:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8485 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.841741:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.841750:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8485 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596784.841800:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596784.841904:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa654e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:2353:x1876527944899968:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 352us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596784.841912:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 66 00010000:00010000:2.0:1789596784.842037:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.842045:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596784.842105:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789596784.842110:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789596784.842132:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.842165:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d847e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fbc expref: 22 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.842195:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8485 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fbc expref: 21 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.842203:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:2.0:1789596784.842206:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596784.842208:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0031000, rc 0) 00000100:00100000:2.0:1789596784.842236:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:11465:x1876527944899840:12345-192.168.202.44@tcp:101:bash.0 Request processed in 7697us (9807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596784.842243:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 161 00000100:00100000:2.0:1789596784.846997:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596784.847191:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944900224 00000100:00100000:3.0:1789596784.847203:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944900224 00000100:00100000:3.0:1789596784.847266:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 45 00000100:00100000:3.0:1789596784.847277:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef52b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:11465:x1876527944900224:12345-192.168.202.44@tcp:35:bash.0 00000100:00100000:3.0:1789596784.847534:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef52b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:11465:x1876527944900224:12345-192.168.202.44@tcp:35:bash.0 Request processed in 258us (547us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1789596784.847542:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 45 00000100:00100000:3.0:1789596784.923205:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596784.923289:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944900480 00000100:00100000:0.0:1789596784.923345:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944900480 00000100:00100000:0.0:1789596784.923462:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 162 00000100:00100000:0.0:1789596784.923474:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:11475:x1876527944900480:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789596784.923501:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596784.923523:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d848c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344fc3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596784.923623:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789596784.923754:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d848c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fc3 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.923769:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8d1438400) 00010000:00010000:0.0:1789596784.923772:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789596784.923778:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d848c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fc3 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.923797:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030c00, rc 0) 00000100:00100000:0.0:1789596784.923965:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:11475:x1876527944900480:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 493us (769us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1789596784.923972:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 162 00000100:00100000:1.0:1789596784.926299:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596784.926391:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944900608 00000100:00100000:0.0:1789596784.926401:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944900608 00000100:00100000:0.0:1789596784.926518:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 163 00000100:00100000:0.0:1789596784.926528:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:11475:x1876527944900608:12345-192.168.202.44@tcp:34:lfs.0 00010000:00010000:0.0:1789596784.926617:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d849a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.926634:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d849a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.926662:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d849a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.926679:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d84a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.926688:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d84a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.926695:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d84a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927023:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927034:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927042:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789596784.927087:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927100:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d849a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927107:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d849a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927113:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d849a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927129:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596784.927133:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d849a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927141:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d849a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927153:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:0.0:1789596784.927156:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596784.927161:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d849a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927167:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d849a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927181:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d84a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927187:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d84a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927193:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d84a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927199:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596784.927201:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d84a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927207:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d84a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927226:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ea8d55e5000) 00010000:00010000:0.0:1789596784.927228:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596784.927231:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d84a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927237:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d84a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927252:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927258:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927265:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927270:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596784.927273:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927279:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927286:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:0.0:1789596784.927288:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596784.927291:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596784.927298:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596784.927400:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa434a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:11475:x1876527944900608:12345-192.168.202.44@tcp:34:lfs.0 Request processed in 872us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596784.927408:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 163 00000100:00100000:3.0:1789596784.932695:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596784.932772:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944900864 00000100:00100000:2.0:1789596784.932782:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944900864 00000100:00100000:2.0:1789596784.932875:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 46 00000100:00100000:2.0:1789596784.932886:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:11475:x1876527944900864:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:2.0:1789596784.933108:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+24:11475:x1876527944900864:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 222us (424us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1789596784.933116:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 46 00000100:00100000:3.0:1789596784.967237:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596784.967443:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944901120 00000100:00100000:2.0:1789596784.967456:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944901120 00000100:00100000:2.0:1789596784.967535:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 164 00000100:00100000:2.0:1789596784.967546:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+24:11478:x1876527944901120:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:2.0:1789596784.967573:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596784.967594:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d84af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344fca expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.967695:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d84b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.967710:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d84b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.967721:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d84b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.967736:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d84bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.967744:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d84bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.967751:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d84bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.969244:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d84c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.969261:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d84c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.969271:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d84c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596784.969283:0:10902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789596784.971548:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d84b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.971581:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d84b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.971770:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d84b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.971780:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596784.971786:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d84b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.971794:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d84b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.971812:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:2.0:1789596784.971933:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596784.971940:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d84b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.971948:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d84b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.971966:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d84bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.971973:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d84bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.971978:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d84bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.971984:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596784.971995:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d84bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.972001:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d84bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.972010:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ea8e0eeac00) 00010000:00010000:2.0:1789596784.972012:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596784.972015:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d84bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.972021:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d84bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.972152:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d84af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fca expref: 27 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.972170:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d84c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fca expref: 26 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.972178:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:2.0:1789596784.972180:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596784.972184:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427a00, rc 0) 00000100:00100000:2.0:1789596784.972262:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:11478:x1876527944901120:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 4717us (5037us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789596784.972272:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 164 00000100:00100000:1.0:1789596784.975166:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596784.975344:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944901248 00000100:00100000:2.0:1789596784.975355:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944901248 00000100:00100000:2.0:1789596784.975422:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 165 00000100:00100000:2.0:1789596784.975432:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:11478:x1876527944901248:12345-192.168.202.44@tcp:54:lfs.0 00010000:00010000:2.0:1789596784.975528:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d84d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.975544:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d84d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.975556:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d84d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.975581:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d84d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.975588:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d84d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.975596:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d84d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.975602:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596784.975607:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d84d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.975614:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d84d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.975624:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:2.0:1789596784.975627:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789596784.975631:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d84d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.975637:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d84d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596784.975722:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa436680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:11478:x1876527944901248:12345-192.168.202.44@tcp:54:lfs.0 Request processed in 290us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596784.975729:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 165 00000100:00100000:3.0:1789596784.978096:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596784.978496:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944901376 00000100:00100000:2.0:1789596784.978505:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944901376 00000100:00100000:2.0:1789596784.978558:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 12 00000100:00100000:2.0:1789596784.978566:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5049880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:2353:x1876527944901376:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596784.978578:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596784.978600:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d84c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fca expref: 26 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596784.978617:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:2.0:1789596784.978621:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596784.978663:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5049880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+25:2353:x1876527944901376:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 99us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596784.978668:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 12 00000100:00100000:3.0:1789596784.980247:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596784.980287:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944901632 00000100:00100000:2.0:1789596784.980294:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944901632 00000100:00100000:2.0:1789596784.980349:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 47 00000100:00100000:2.0:1789596784.980356:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+25:11478:x1876527944901632:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:2.0:1789596784.980531:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:11478:x1876527944901632:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 176us (292us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789596784.980536:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 47 00000100:00100000:1.0:1789596785.002204:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596785.002245:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596785.002276:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596785.002306:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944902016 00000100:00100000:1.0:1789596785.002323:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596785.002327:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944902016 00000100:00100000:1.0:1789596785.002351:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944902144 00000100:00100000:1.0:1789596785.002357:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944902144 00000100:00100000:2.0:1789596785.002407:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944901888 00000100:00100000:2.0:1789596785.002412:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944901888 00000100:00100000:1.0:1789596785.002417:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 148 00000100:00100000:1.0:1789596785.002430:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2351:x1876527944902144:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596785.002445:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 69 00000100:00100000:2.0:1789596785.002456:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2351:x1876527944902016:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596785.002523:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944901760 00000100:00100000:3.0:1789596785.002529:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944901760 00000100:00100000:3.0:1789596785.002560:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 292 00000100:00100000:3.0:1789596785.002568:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2351:x1876527944901760:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596785.002637:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 70 00000100:00100000:0.0:1789596785.002648:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2351:x1876527944901888:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596785.002713:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2351:x1876527944902144:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 286us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596785.002721:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 148 00000100:00080000:1.0:1789596785.002771:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789596785.002777:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789596785.002779:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596785.005293:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa436a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2351:x1876527944902016:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 2824us (3031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596785.005311:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 69 00000100:00100000:3.0:1789596785.006588:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2351:x1876527944901760:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 4010us (4382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596785.006611:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 292 00000100:00100000:0.0:1789596785.006775:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2351:x1876527944901888:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 4129us (4496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596785.006785:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 70 00000100:00100000:3.0:1789596785.106476:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596785.111707:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944902400 00000100:00100000:2.0:1789596785.111722:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944902400 00000100:00100000:2.0:1789596785.111901:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 166 00000100:00100000:2.0:1789596785.111914:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:11497:x1876527944902400:12345-192.168.202.44@tcp:101:cat.0 00010000:00010000:2.0:1789596785.111939:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596785.111962:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d84d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344fd1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.112530:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d84e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.112547:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d84e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.112561:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d84e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596785.112574:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789596785.112713:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427a00/0x8973ae90b38d84d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fd1 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.112734:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d84e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fd1 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.112758:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:2.0:1789596785.112762:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789596785.112766:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427800, rc 0) 00000100:00100000:2.0:1789596785.114036:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900464e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+28:11497:x1876527944902400:12345-192.168.202.44@tcp:101:cat.0 Request processed in 2119us (7564us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789596785.114046:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 166 00000100:00100000:1.0:1789596785.139893:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596785.139999:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944902528 00000100:00100000:0.0:1789596785.140011:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944902528 00000100:00100000:0.0:1789596785.140388:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 167 00000100:00100000:0.0:1789596785.140400:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+28:11498:x1876527944902528:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789596785.140430:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596785.140451:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344fd8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.140547:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d84f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.140560:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d84f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.140568:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d84f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596785.141252:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789596785.141259:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789596785.141294:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d84f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.141336:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fd8 expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.141360:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d84f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fd8 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.141368:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:0.0:1789596785.141370:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789596785.141374:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c1483600, rc 0) 00000100:00100000:0.0:1789596785.141448:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+29:11498:x1876527944902528:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 1051us (2001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596785.141456:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 167 00000100:00100000:1.0:1789596785.154738:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596785.156499:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944902912 00000100:00100000:0.0:1789596785.156513:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944902912 00000100:00100000:0.0:1789596785.156590:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 48 00000100:00100000:0.0:1789596785.156601:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+29:11498:x1876527944902912:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:0.0:1789596785.157151:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+30:11498:x1876527944902912:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 550us (2421us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1789596785.157159:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 48 00000100:00100000:3.0:1789596785.159940:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596785.160176:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944903040 00000100:00100000:0.0:1789596785.160237:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944903040 00000100:00100000:0.0:1789596785.160394:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 13 00000100:00100000:0.0:1789596785.160405:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900464000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+30:11498:x1876527944903040:12345-192.168.202.44@tcp:103:lfs.0 00010000:00010000:0.0:1789596785.160423:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789596785.160603:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d8485 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fbc expref: 30 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.160629:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d84e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fd1 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.160643:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d8389 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f7d expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.160653:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d1438300) 00010000:00010000:0.0:1789596785.160665:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596785.160774:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900464000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:11498:x1876527944903040:12345-192.168.202.44@tcp:103:lfs.0 Request processed in 371us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596785.160782:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 13 00000100:00100000:1.0:1789596785.165368:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596785.165583:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944903168 00000100:00100000:0.0:1789596785.165595:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944903168 00000100:00100000:0.0:1789596785.165711:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 168 00000100:00100000:0.0:1789596785.165721:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:11498:x1876527944903168:12345-192.168.202.44@tcp:58:lfs.0 00010000:00010000:0.0:1789596785.166286:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.166304:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.166326:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789596785.166785:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789596785.167687:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:11498:x1876527944903168:12345-192.168.202.44@tcp:58:lfs.0 Request processed in 1961us (2322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596785.167711:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 168 00000100:00100000:1.0:1789596785.192237:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596785.192472:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944903296 00000100:00100000:0.0:1789596785.192483:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944903296 00000100:00100000:0.0:1789596785.192544:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 169 00000100:00100000:0.0:1789596785.192554:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:11500:x1876527944903296:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789596785.192577:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596785.192607:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8503 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344fdf expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.192678:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d850a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.192693:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d850a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.192705:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d850a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.192720:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8511 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.192727:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.192733:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.192977:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8518 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.192996:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.193004:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596785.193049:0:10902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789596785.193053:0:10902:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789596785.193075:0:10902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.193088:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8518 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.193097:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d850a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.193104:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d850a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.193112:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d850a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.193119:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596785.193124:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d850a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.193132:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d850a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.193146:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:0.0:1789596785.193156:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596785.193162:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d850a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.193169:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d850a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.193546:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.193555:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8511 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.193562:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8511 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.193567:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596785.193570:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8511 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.193576:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8511 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.193585:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ea8d55e5500) 00010000:00010000:0.0:1789596785.193587:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596785.193598:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8511 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.193605:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8511 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.193643:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8503 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fdf expref: 29 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.193671:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fdf expref: 28 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596785.193679:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d55e5000) 00010000:00010000:0.0:1789596785.193682:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789596785.193685:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030c00, rc 0) 00000100:00100000:0.0:1789596785.193756:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+28:11500:x1876527944903296:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 1203us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596785.193764:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 169 00000001:00080000:1.0:1789596785.262031:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1789596785.262233:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:3.0:1789596785.564692:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789596785.627209:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789596785.627219:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789596785.627271:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1789596785.627278:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789596785.627418:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef528380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876527964822016:192.168.202.44@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789596785.627520:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f69120c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596785.638244:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596785.638449:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944903424 00000100:00100000:3.0:1789596785.638458:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944903424 00000100:00100000:0.0:1789596785.638465:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef528380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876527964822016:192.168.202.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789596785.638520:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 170 00000100:00100000:3.0:1789596785.638531:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef52ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+28:11511:x1876527944903424:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789596785.638561:0:5841:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789596785.638671:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef52ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+28:11511:x1876527944903424:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 Request processed in 141us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596785.638678:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 170 00000100:00100000:1.0:1789596785.647363:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596785.647651:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944903552 00000100:00100000:2.0:1789596785.647662:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944903552 00000100:00100000:2.0:1789596785.647715:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 171 00000100:00100000:2.0:1789596785.647724:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+28:11511:x1876527944903552:12345-192.168.202.44@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789596785.647807:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d851f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.647857:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d851f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.647870:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d851f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.647929:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d8526 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.647952:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d8526 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.647960:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d8526 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.647989:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d852d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.647999:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d852d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648006:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d852d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596785.648045:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789596785.648050:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789596785.648064:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d852d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648075:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d851f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648081:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d851f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648088:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d851f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648094:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596785.648098:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d851f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648113:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d851f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648126:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ea8d55e5800) 00010000:00010000:2.0:1789596785.648129:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596785.648134:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d851f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648141:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d851f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648153:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d8526 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648158:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d8526 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648165:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d8526 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648170:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596785.648173:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d8526 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648179:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d8526 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648187:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9ea8e0eea600) 00010000:00010000:2.0:1789596785.648190:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596785.648193:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d8526 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648210:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d8526 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648224:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d852d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648230:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d852d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648236:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d852d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648241:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596785.648244:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d852d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648250:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d852d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648257:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d55e5000) 00010000:00010000:2.0:1789596785.648259:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596785.648262:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d852d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.648267:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d852d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596785.648378:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+28:11511:x1876527944903552:12345-192.168.202.44@tcp:34:lhsmtool_posix.0 Request processed in 645us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596785.648386:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 171 00000100:00100000:0.0:1789596785.655499:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596785.656132:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944903808 00000100:00100000:3.0:1789596785.656146:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944903808 00000100:00100000:3.0:1789596785.656210:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 172 00000100:00100000:3.0:1789596785.656221:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+28:11511:x1876527944903808:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596785.656242:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596785.656263:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d8534 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344fe6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.656378:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d853b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.656394:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d853b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.656406:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d853b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596785.656420:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789596785.656514:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d853b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.656541:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d853b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.656548:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d853b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.656553:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596785.656558:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d853b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.656565:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d853b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.656577:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d55e5000) 00010000:00010000:3.0:1789596785.656580:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789596785.656585:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d853b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.656590:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d853b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.656633:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d8534 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fe6 expref: 30 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.656645:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ea8d55e5800) 00010000:00010000:3.0:1789596785.656647:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789596785.656651:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d8534 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fe6 expref: 30 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.656660:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89200, rc 0) 00000100:00100000:3.0:1789596785.656726:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+29:11511:x1876527944903808:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 507us (1236us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1789596785.656733:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 172 00000100:00100000:1.0:1789596785.659991:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596785.660542:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944903936 00000100:00100000:3.0:1789596785.660554:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944903936 00000100:00100000:3.0:1789596785.660650:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 173 00000100:00100000:3.0:1789596785.660661:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+29:11511:x1876527944903936:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789596785.660699:0:10902:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789596785.660813:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+29:11511:x1876527944903936:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 Request processed in 153us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596785.660842:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 173 00000100:00100000:1.0:1789596785.669681:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596785.670145:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944904192 00000100:00100000:2.0:1789596785.670157:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944904192 00000100:00100000:2.0:1789596785.670217:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 174 00000100:00100000:2.0:1789596785.670228:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+29:11511:x1876527944904192:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596785.670250:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596785.670253:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789596785.670281:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d84f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fd8 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.670303:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:2.0:1789596785.670317:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596785.670332:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d8549 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344fed expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789596785.671107:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789596785.671380:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d8550 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.671395:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d8550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.671406:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d8550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.671464:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d8549 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fed expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.671481:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d8550 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fed expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.671503:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ea8e0eea600) 00010000:00010000:2.0:1789596785.671506:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596785.671509:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426000, rc 0) 00000100:00100000:2.0:1789596785.671572:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+30:11511:x1876527944904192:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 1345us (1900us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1789596785.671579:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 174 00000100:00100000:1.0:1789596785.679966:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596785.682966:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944904448 00000100:00100000:2.0:1789596785.682987:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944904448 00000100:00100000:2.0:1789596785.684641:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 175 00000100:00100000:2.0:1789596785.684664:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+30:11511:x1876527944904448:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789596785.684731:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596785.684762:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d8550 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fed expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.684781:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ea8e0eea600) 00010000:00010000:2.0:1789596785.684792:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596785.684828:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d855e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.684843:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d855e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.684854:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d855e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.684869:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8565 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe42427b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.684894:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8565 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe42427b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.684902:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8565 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe42427b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.685089:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d855e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.685098:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d855e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.685103:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d855e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.685109:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596785.685113:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d855e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.685120:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d855e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.685128:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:2.0:1789596785.685131:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596785.685135:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d855e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.685140:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d855e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.685148:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8565 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe42427b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.685160:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8565 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe42427b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.685166:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8565 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe42427b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.685171:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596785.685174:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8565 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe42427b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.685180:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8565 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe42427b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.685187:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe42427b3 (ffff9ea8e0eeac00) 00010000:00010000:2.0:1789596785.685190:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596785.685192:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8565 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe42427b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.685198:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d8565 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe42427b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596785.685281:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+29:11511:x1876527944904448:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 Request processed in 626us (5323us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789596785.685288:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 175 00000100:00100000:0.0:1789596785.703223:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596785.704402:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944904576 00000100:00100000:1.0:1789596785.704419:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944904576 00000100:00100000:1.0:1789596785.704519:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 176 00000100:00100000:1.0:1789596785.704529:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+29:11511:x1876527944904576:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789596785.704551:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596785.704577:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d856c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344ff4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596785.704613:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d8573 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596785.704627:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d8573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596785.704636:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d8573 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596785.704717:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d856c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ff4 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596785.704730:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d8573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ff4 expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596785.704744:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ea8c36d5e00) 00010000:00010000:1.0:1789596785.704746:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789596785.704749:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a33800, rc 0) 00000100:00100000:1.0:1789596785.704799:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+30:11511:x1876527944904576:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 272us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596785.704804:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 176 00000100:00100000:1.0:1789596785.720327:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596785.720406:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944904832 00000100:00100000:3.0:1789596785.720417:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944904832 00000100:00100000:3.0:1789596785.720480:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 177 00000100:00100000:3.0:1789596785.720491:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff53a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+30:11511:x1876527944904832:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789596785.720578:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d857a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.720594:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d857a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.720605:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d857a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789596785.721120:0:10902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1789596785.721132:0:10902:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 370685314743ns, next at 371685312578ns, rc = 0 00000004:00010000:1.0:1789596785.721217:0:10902:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c91491c reply state 000000009ace28ea transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d857a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596785.721227:0:10902:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789596785.721364:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff53a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+32:11511:x1876527944904832:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 Request processed in 873us (1055us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1789596785.721372:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 177 00010000:00010000:2.0:1789596785.727438:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d857a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.727457:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d857a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.727484:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d857a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.727491:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596785.727496:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d857a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.727505:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d857a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.727522:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ea8c36d5e00) 00010000:00010000:2.0:1789596785.727526:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789596785.727531:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d857a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.727538:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d857a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596785.729881:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596785.730559:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944904960 00000100:00100000:2.0:1789596785.730571:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944904960 00000100:00100000:2.0:1789596785.730634:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 178 00000100:00100000:2.0:1789596785.730646:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+31:11511:x1876527944904960:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596785.730671:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596785.730692:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d8581 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c344ffb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.730755:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d8581 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ffb expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.730783:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d8581 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ffb expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.730806:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ea8c36d5e00) 00010000:00010000:2.0:1789596785.730810:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596785.731043:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426600, rc 0) 00000100:00100000:2.0:1789596785.731123:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+32:11511:x1876527944904960:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 477us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596785.731131:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 178 00000100:00100000:3.0:1789596785.734682:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596785.735530:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944905088 00000100:00100000:2.0:1789596785.735544:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944905088 00000100:00100000:2.0:1789596785.735621:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 51 00000100:00100000:2.0:1789596785.735633:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2354:x1876527944905088:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789596785.736057:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2354:x1876527944905088:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 Request processed in 424us (1383us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789596785.736065:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 51 00000100:00100000:3.0:1789596785.742671:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596785.742888:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944905344 00000100:00100000:0.0:1789596785.743028:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944905344 00000100:00100000:0.0:1789596785.743101:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 49 00000100:00100000:0.0:1789596785.743112:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+32:11511:x1876527944905344:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789596785.743460:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+33:11511:x1876527944905344:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 Request processed in 349us (798us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789596785.743468:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 49 00000100:00100000:2.0:1789596785.757547:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596785.757629:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944905600 00000100:00100000:1.0:1789596785.757641:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944905600 00000100:00100000:1.0:1789596785.757707:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 179 00000100:00100000:1.0:1789596785.757721:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef52bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+33:11511:x1876527944905600:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789596785.757865:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef52bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+33:11511:x1876527944905600:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 Request processed in 146us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596785.757874:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 179 00000100:00100000:0.0:1789596785.761077:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596785.764626:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944905728 00000100:00100000:2.0:1789596785.764642:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944905728 00000100:00100000:2.0:1789596785.764728:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 180 00000100:00100000:2.0:1789596785.764740:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+33:11511:x1876527944905728:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596785.764765:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596785.764792:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8588 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345002 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.764935:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d858f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.764951:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d858f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.764965:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d858f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596785.765006:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789596785.765029:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d858f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.765069:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8588 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345002 expref: 35 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.765093:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d858f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345002 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596785.765102:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ea8c36d5e00) 00010000:00010000:2.0:1789596785.765105:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789596785.765109:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426000, rc 0) 00000100:00100000:2.0:1789596785.765177:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+34:11511:x1876527944905728:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 440us (4113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596785.765184:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 180 00000100:00100000:3.0:1789596785.772029:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596785.774011:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944905856 00000100:00100000:3.0:1789596785.774030:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944905856 00000100:00100000:3.0:1789596785.774098:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 52 00000100:00100000:3.0:1789596785.774108:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2353:x1876527944905856:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596785.774125:0:9219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596785.774145:0:9219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8596 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345009 expref: -99 pid: 9219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789596785.774173:0:9219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab1471, blocks: 0x1 00010000:00010000:3.0:1789596785.774191:0:9219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=370s v=(0 0) 00010000:00010000:3.0:1789596785.774196:0:9219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596785.774205:0:9219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8596 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345009 expref: 8 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.774223:0:9219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8596 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345009 expref: 8 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.774448:0:9219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88400, rc 0) 00000100:00100000:3.0:1789596785.774521:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2353:x1876527944905856:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 414us (2504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596785.774529:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 52 00000100:00100000:1.0:1789596785.785388:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596785.785565:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944906112 00000100:00100000:0.0:1789596785.785577:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944906112 00000100:00100000:0.0:1789596785.785637:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 181 00000100:00100000:0.0:1789596785.785648:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff53bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+34:11511:x1876527944906112:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789596785.785774:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff53bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+34:11511:x1876527944906112:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 Request processed in 127us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596785.785783:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 181 00000100:00100000:0.0:1789596785.790681:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596785.790753:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944906240 00000100:00100000:3.0:1789596785.790765:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944906240 00000100:00100000:3.0:1789596785.790847:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 53 00000100:00100000:3.0:1789596785.790857:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:11511:x1876527944906240:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596785.791320:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596785.791344:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d859d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345010 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.791396:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8596 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345009 expref: 9 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.791405:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596785.791409:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596785.791415:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d859d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345010 expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.791448:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8596 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345009 expref: 9 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.791461:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8596 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345009 expref: 9 pid: 9219 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596785.791475:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6693:1876527964822144:192.168.202.44@tcp:104: 00000100:00100000:3.0:1789596785.791558:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff4b0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596785.806534:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596785.806645:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944906368 00000100:00100000:1.0:1789596785.806656:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944906368 00010000:00010000:1.0:1789596785.806703:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8596 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345009 expref: 10 pid: 9219 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596785.806752:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 67 00000100:00100000:1.0:1789596785.806762:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa656d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+10:2353:x1876527944906368:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596785.806781:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596785.806805:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8596 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345009 expref: 10 pid: 9219 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596785.806848:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8596 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345009 expref: 10 pid: 9219 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596785.806875:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596785.806879:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596785.806889:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d859d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345010 expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596785.806898:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d859d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345010 expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.806907:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8596 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345009 expref: 10 pid: 9219 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596785.806923:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6693:1876527964822144:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596785.806936:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d859d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345010 expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596785.806949:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ff538000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1876527964822272:192.168.202.44@tcp:105: 00010000:00010000:3.0:1789596785.806951:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d859d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345010 expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596785.806961:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89200, rc 0) 00000100:00100000:3.0:1789596785.807019:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:11511:x1876527944906240:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 16163us (16347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596785.807026:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 53 00000100:00100000:1.0:1789596785.817806:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6948c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789596785.827961:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596785.828133:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ff538000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1876527964822272:192.168.202.44@tcp:105: 00000100:00100000:0.0:1789596785.828151:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944906496 00010000:00010000:1.0:1789596785.828155:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596785.828158:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944906496 00000100:00100000:1.0:1789596785.828210:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa656d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:2353:x1876527944906368:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 21449us (21687us total) trans 0 rc 0/0 00002000:00100000:0.0:1789596785.828210:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ea8ef52a680 x1876527944906496/t0(0) o4->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:666/0 lens 504/0 e 0 to 0 dl 1789596796 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789596785.828220:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8ef52a680 with x1876527944906496 ext(0->8) 00000100:00100000:1.0:1789596785.828221:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 67 00002000:00010000:0.0:1789596785.828225:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ea8ef52a680 00000100:00100000:0.0:1789596785.828249:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 4 00000100:00100000:0.0:1789596785.828257:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef52a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2354:x1876527944906496:12345-192.168.202.44@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789596785.828713:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef52a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+10:2354:x1876527944906496:12345-192.168.202.44@tcp:4:lhsmtool_posix.0 Request processed in 455us (761us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789596785.828722:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 4 00002000:00100000:0.0:1789596785.828728:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ea8ef52a680 x1876527944906496/t4294967314(0) o4->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:666/0 lens 504/448 e 0 to 0 dl 1789596796 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789596785.828737:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8ef52a680 with x1876527944906496 ext(0->8) 00002000:00010000:0.0:1789596785.828740:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ea8ef52a680 00000100:00100000:0.0:1789596785.840094:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596785.840267:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944906624 00000100:00100000:2.0:1789596785.840278:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944906624 00000100:00100000:2.0:1789596785.840386:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 182 00000100:00100000:2.0:1789596785.840396:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+34:11511:x1876527944906624:12345-192.168.202.44@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789596785.978176:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+34:11511:x1876527944906624:12345-192.168.202.44@tcp:44:lhsmtool_posix.0 Request processed in 137770us (138081us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596785.978191:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 182 00000001:00080000:2.0:1789596785.978243:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1789596785.978263:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:2.0:1789596785.978279:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:2.0:1789596785.978462:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef52a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964822400:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789596785.978517:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789596785.978572:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1789596785.978585:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789596785.978591:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964822400 00000100:00100000:2.0:1789596785.978599:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964822400 00000100:00100000:2.0:1789596785.978661:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789596785.978669:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964822400:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1789596785.978717:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1789596785.978844:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789596785.978849:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789596785 00002000:00010000:2.0:1789596785.978851:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789596785.978853:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789596785 -> 1789596785 00002000:00010000:2.0:1789596785.978856:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789596785.978891:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef52aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1876527964822400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 222us (374us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789596785.978898:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:0.0:1789596785.978942:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ea8ef52a300/2, rc 0, transno 4294967315 00000100:00100000:0.0:1789596785.978948:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef52a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964822400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789596785.982190:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596785.982356:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944906752 00000100:00100000:3.0:1789596785.982366:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944906752 00000100:00100000:3.0:1789596785.982429:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 55 00000100:00100000:3.0:1789596785.982439:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+10:2353:x1876527944906752:12345-192.168.202.44@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789596786.100078:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:2.0:1789596786.100113:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1789596786.100277:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2353:x1876527944906752:12345-192.168.202.44@tcp:16:lhsmtool_posix.0 Request processed in 117824us (118081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596786.100288:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 55 00000100:00100000:1.0:1789596786.115241:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.115516:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944907008 00000100:00100000:0.0:1789596786.115528:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944907008 00000100:00100000:0.0:1789596786.115606:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 183 00000100:00100000:0.0:1789596786.115617:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:11511:x1876527944907008:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789596786.115680:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596786.115710:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426000/0x8973ae90b38d858f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345002 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.115728:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ea8c36d5e00) 00010000:00010000:0.0:1789596786.115734:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596786.115765:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.115779:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.115789:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789596786.116093:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007dbd8fde reply state 00000000f32d8861 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596786.116103:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789596786.116208:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:11511:x1876527944907008:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 Request processed in 592us (975us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1789596786.116215:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 183 00000100:00080000:1.0:1789596786.116916:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789596786.127493:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596786.128322:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.130971:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944907136 00000100:00100000:0.0:1789596786.130988:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944907136 00000100:00100000:0.0:1789596786.131052:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 56 00000100:00100000:0.0:1789596786.131062:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2354:x1876527944907136:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789596786.131335:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789596786.131339:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789596785 -> 1789596784 00002000:00010000:0.0:1789596786.131342:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789596783 00002000:00010000:0.0:1789596786.131344:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789596785 -> 1789596784 00002000:00010000:0.0:1789596786.131346:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789596786.131523:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2354:x1876527944907136:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 Request processed in 461us (3205us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789596786.131531:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 56 00010000:00010000:3.0:1789596786.134322:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.134345:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.134352:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596786.134368:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.134378:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.134398:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ea8c36d5e00) 00010000:00010000:3.0:1789596786.134400:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596786.134405:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.134429:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596786.139754:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.148048:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944907392 00000100:00100000:0.0:1789596786.148066:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944907392 00000100:00100000:0.0:1789596786.149357:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 184 00000100:00100000:0.0:1789596786.149376:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:11511:x1876527944907392:12345-192.168.202.44@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789596786.149456:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.149475:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d8573 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ff4 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.149484:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85ab lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.149523:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d8573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ff4 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.149553:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d8573 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ff4 expref: 18 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596786.149570:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa654700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1876527964822528:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789596786.149681:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ef49d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789596786.154225:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa654700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1876527964822528:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789596786.154237:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00010000:00010000:2.0:1789596786.154273:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596786.154444:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944907520 00000100:00100000:3.0:1789596786.154453:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944907520 00010000:00010000:3.0:1789596786.154491:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d8573 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ff4 expref: 19 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596786.154538:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 68 00000100:00100000:3.0:1789596786.154548:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff53b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:2353:x1876527944907520:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596786.154563:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596786.154570:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d8573 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ff4 expref: 19 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.154582:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d8573 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ff4 expref: 19 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.154605:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d8573 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ff4 expref: 19 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.154621:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ea8c36d5e00) 00010000:00010000:3.0:1789596786.154626:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.154637:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.154656:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85ab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.154685:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596786.154734:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff53b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:2353:x1876527944907520:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 188us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596786.154742:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 68 00010000:00010000:2.0:1789596786.155428:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.155438:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.155469:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.155477:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.155484:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.155490:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596786.155494:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.155501:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.155511:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ea8c36d5e00) 00010000:00010000:2.0:1789596786.155514:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789596786.155518:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.155523:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596786.155605:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+17:11511:x1876527944907392:12345-192.168.202.44@tcp:55:lhsmtool_posix.0 Request processed in 6235us (15861us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789596786.155614:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 184 00000100:00100000:0.0:1789596786.161601:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596786.161683:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944907648 00000100:00100000:3.0:1789596786.161695:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944907648 00000100:00100000:3.0:1789596786.161789:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 57 00000100:00100000:3.0:1789596786.161800:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2354:x1876527944907648:12345-192.168.202.44@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789596786.161864:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d85b2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.161885:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d859d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345010 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.161893:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789596786.161897:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789596786.161902:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d85b2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.161939:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d859d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345010 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.161954:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d859d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345010 expref: 8 pid: 6693 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596786.161978:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6693:1876527964822656:192.168.202.44@tcp:104: 00000100:00100000:3.0:1789596786.162063:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596786.175053:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6693:1876527964822656:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596786.175091:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d85b2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596786.175192:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.175381:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944907776 00000100:00100000:0.0:1789596786.175391:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944907776 00010000:00010000:0.0:1789596786.175432:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d859d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345010 expref: 9 pid: 6693 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596786.175661:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 69 00000100:00100000:0.0:1789596786.175673:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d5fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:2354:x1876527944907776:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596786.175689:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596786.175716:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d859d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345010 expref: 9 pid: 6693 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.175731:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d859d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345010 expref: 9 pid: 6693 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.175761:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b25d8239/0x8973ae90b38d859d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345010 expref: 9 pid: 6693 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.175779:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789596786.175784:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789596786.175795:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d85b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.175805:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d85b2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.175862:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596786.175915:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d5fafc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2354:x1876527944907776:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 243us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596786.175923:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 69 00010000:00010000:2.0:1789596786.176088:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d85b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.176097:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d85b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.176122:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d85b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.176130:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d85b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.176138:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d85b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.176145:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88400 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596786.176149:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d85b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.176158:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d85b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.176182:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d85b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.176190:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d85b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596786.176241:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2354:x1876527944907648:12345-192.168.202.44@tcp:1:lhsmtool_posix.0 Request processed in 14442us (14649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596786.176249:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 57 00000100:00100000:1.0:1789596786.187441:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.187509:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944908032 00000100:00100000:0.0:1789596786.187519:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944908032 00000100:00100000:0.0:1789596786.187577:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 185 00000100:00100000:0.0:1789596786.187587:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff53b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+17:11511:x1876527944908032:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789596786.187667:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.187685:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.187696:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.187933:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.187945:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d8581 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ffb expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.187953:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85c0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.187990:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d8581 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ffb expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.188003:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d8581 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ffb expref: 18 pid: 5841 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596786.188017:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa654e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964822784:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789596786.188428:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ef49d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596786.207579:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596786.208349:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944908160 00000100:00100000:3.0:1789596786.208362:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944908160 00010000:00010000:3.0:1789596786.208405:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d8581 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ffb expref: 19 pid: 5841 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596786.208457:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 70 00000100:00100000:3.0:1789596786.208467:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa656d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:2354:x1876527944908160:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596786.208482:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596786.208489:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d8581 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ffb expref: 19 pid: 5841 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.208503:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d8581 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ffb expref: 19 pid: 5841 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.208524:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ea8c36d5e00) 00010000:00010000:3.0:1789596786.208531:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.208541:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.208548:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85c0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.208567:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596786.208637:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa656d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:2354:x1876527944908160:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 172us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596786.208646:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 70 00010000:00010000:1.0:1789596786.216921:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d8581 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344ffb expref: 18 pid: 5841 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596786.216953:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa654e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964822784:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596786.216986:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.216997:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.217004:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789596786.217280:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1789596786.217475:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1789596786.217521:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1789596786.217622:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea7c351ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1876527964822912:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789596786.217690:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596786.217738:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c905ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596786.217876:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964822912 00000100:00100000:3.0:1789596786.217885:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964822912 00000100:00100000:3.0:1789596786.217944:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789596786.217953:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea7c351dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1876527964822912:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789596786.218045:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea7c351dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1876527964822912:12345-0@lo:1000:mdt00_002.0 Request processed in 92us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596786.218053:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789596786.220203:0:5843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1789596786.220216:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ea8ef52a300, transno 4294967315 00000100:00100000:1.0:1789596786.220244:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea7c351ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1876527964822912:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789596786.223152:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1789596786.223283:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea7c351ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1876527964823040:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789596786.224193:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596786.224235:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c905cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596786.224315:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964823040 00000100:00100000:3.0:1789596786.224326:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964823040 00000100:00100000:3.0:1789596786.224385:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789596786.224397:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea7c351d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1876527964823040:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789596786.228956:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea7c351d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1876527964823040:12345-0@lo:1000:mdt00_002.0 Request processed in 4553us (4757us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789596786.228971:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789596786.231351:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea7c351ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5843:1876527964823040:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789596786.231410:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.231421:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85c0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.231430:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.231437:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596786.231442:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.231451:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85c0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.231469:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ea8c36d5e00) 00010000:00010000:2.0:1789596786.231479:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596786.231485:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85c0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.231491:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85c0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.231523:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.231530:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.231536:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.231541:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596786.231544:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.231550:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.231557:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d55e5000) 00010000:00010000:2.0:1789596786.231559:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596786.231561:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.231567:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d84fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.231585:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d85c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.231607:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8518 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fdf expref: 21 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.231616:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d85c7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.231650:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8518 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fdf expref: 21 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.231665:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8518 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fdf expref: 21 pid: 10902 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596786.231679:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef529500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964823168:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789596786.231762:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6912300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596786.242525:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596786.242559:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944908288 00000100:00100000:1.0:1789596786.242568:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944908288 00010000:00010000:1.0:1789596786.242612:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8518 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fdf expref: 22 pid: 10902 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596786.242652:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 71 00000100:00100000:1.0:1789596786.242662:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea7c351c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:2353:x1876527944908288:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596786.242679:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596786.242686:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8518 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fdf expref: 22 pid: 10902 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.242698:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8518 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fdf expref: 22 pid: 10902 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.242731:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d55e5000) 00010000:00010000:1.0:1789596786.242737:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d85c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.242749:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d85c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.242757:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d85c7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.242770:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8518 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344fdf expref: 22 pid: 10902 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.242776:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596786.242788:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef529500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964823168:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789596786.242810:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d85c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596786.242849:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea7c351c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:2353:x1876527944908288:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 189us (335us total) trans 0 rc 0/0 00010000:00010000:3.0:1789596786.242850:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d85c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.242857:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d85c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596786.242857:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 71 00010000:00010000:3.0:1789596786.242876:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d85c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.242883:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d85c7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.242890:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d85c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.242896:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596786.242900:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d85c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.242907:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d85c7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.242916:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d55e5000) 00010000:00010000:3.0:1789596786.242919:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596786.242922:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d85c7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.242928:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d85c7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.242938:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.242944:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.242950:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.242960:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596786.242964:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.242970:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.242977:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d55e5000) 00010000:00010000:3.0:1789596786.242980:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789596786.242983:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.242988:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d85b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596786.244720:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff53b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:11511:x1876527944908032:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 Request processed in 57123us (57274us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1789596786.244734:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 185 00000020:00080000:3.0:1789596786.244739:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789596786.245680:0:12470:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789596786.245687:0:12470:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789596786.245729:0:12470:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1789596786.245734:0:12470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789596786.246945:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789596786.246953:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789596786.248589:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789596786.248607:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789596786.263637:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596786.264402:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944908544 00000100:00100000:3.0:1789596786.264415:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944908544 00000100:00100000:3.0:1789596786.264489:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 50 00000100:00100000:3.0:1789596786.264501:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3552c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:11511:x1876527944908544:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789596786.266546:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789596786.267510:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1789596786.267583:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d85ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.268142:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d85ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.268169:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d85ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.268179:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d85ce lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.268185:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d85ce lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.268192:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d85ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.268221:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789596786.268766:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3552c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:11511:x1876527944908544:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 Request processed in 4262us (5133us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789596786.268778:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 50 00000020:00080000:3.0:1789596786.268785:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789596786.269155:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596786.269164:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d85ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.269172:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89e00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596786.269176:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d85ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.269185:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d85ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.269216:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ea8d1438900) 00010000:00010000:2.0:1789596786.269219:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789596786.269225:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d85ce lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.269230:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d85ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.269249:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596786.269251:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596786.269253:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596786.448938:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.454295:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944908800 00000100:00100000:0.0:1789596786.454324:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944908800 00000100:00100000:0.0:1789596786.454402:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 186 00000100:00100000:0.0:1789596786.454414:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:11521:x1876527944908800:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789596786.454446:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596786.454472:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d85d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345017 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.454573:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.454588:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.454616:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596786.454628:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789596786.454749:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d85d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345017 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.454771:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345017 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.454779:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:0.0:1789596786.454783:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789596786.454786:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0031000, rc 0) 00000100:00100000:0.0:1789596786.454864:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+24:11521:x1876527944908800:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 453us (5935us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1789596786.454870:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 186 00000100:00100000:0.0:1789596786.463500:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596786.463678:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944908928 00000100:00100000:2.0:1789596786.463689:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944908928 00000100:00100000:2.0:1789596786.463749:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 187 00000100:00100000:2.0:1789596786.463761:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+24:11521:x1876527944908928:12345-192.168.202.44@tcp:34:lfs.0 00010000:00010000:2.0:1789596786.463856:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d85ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.463874:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d85ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.463887:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d85ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.463915:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d85f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.463924:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d85f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.463931:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d85f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464161:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d85f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464171:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d85f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464177:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d85f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596786.464216:0:10902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d85f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464228:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d85ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464236:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d85ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464243:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d85ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464250:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596786.464254:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d85ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464262:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d85ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464275:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:2.0:1789596786.464278:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596786.464282:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d85ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464295:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d85ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464317:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d85f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464325:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d85f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464331:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d85f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464336:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596786.464339:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d85f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464345:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d85f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464353:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ea8e0eea600) 00010000:00010000:2.0:1789596786.464355:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596786.464358:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d85f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464363:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426400/0x8973ae90b38d85f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464378:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d85f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464384:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d85f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464396:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d85f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464401:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596786.464403:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d85f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464409:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d85f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464416:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8e0eeac00) 00010000:00010000:2.0:1789596786.464418:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596786.464421:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d85f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.464426:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d85f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596786.464509:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa655180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+24:11521:x1876527944908928:12345-192.168.202.44@tcp:34:lfs.0 Request processed in 749us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596786.464517:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 187 00000100:00100000:1.0:1789596786.529336:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596786.529407:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944909184 00000100:00100000:3.0:1789596786.529418:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944909184 00000100:00100000:3.0:1789596786.529478:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 188 00000100:00100000:3.0:1789596786.529488:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea7c351f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+24:11524:x1876527944909184:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:3.0:1789596786.529510:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596786.529531:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d85ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c34501e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.529610:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8606 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.529642:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8606 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.529654:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8606 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.529672:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d860d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.529679:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d860d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.529685:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d860d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.541202:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8614 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.541223:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.541235:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8614 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596786.541249:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789596786.541376:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8606 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.541384:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8606 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.541390:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8606 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.541397:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596786.541402:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8606 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.541408:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8606 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.541420:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:2.0:1789596786.541423:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596786.541428:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8606 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.541433:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8606 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.541446:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d860d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.541451:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d860d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.541457:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d860d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.541462:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596786.541472:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d860d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.541480:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d860d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.541489:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ea8d1438200) 00010000:00010000:2.0:1789596786.541491:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596786.541495:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d860d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.541501:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d860d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.541557:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d85ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34501e expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.541572:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8614 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34501e expref: 26 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.541580:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8e0eeac00) 00010000:00010000:2.0:1789596786.541582:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596786.541584:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426e00, rc 0) 00000100:00100000:2.0:1789596786.541848:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea7c351f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:11524:x1876527944909184:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 12360us (12521us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1789596786.541858:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 188 00000100:00100000:2.0:1789596786.550872:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.550957:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944909312 00000100:00100000:0.0:1789596786.550969:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944909312 00000100:00100000:0.0:1789596786.551033:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 189 00000100:00100000:0.0:1789596786.551045:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef52b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:11524:x1876527944909312:12345-192.168.202.44@tcp:54:lfs.0 00010000:00010000:0.0:1789596786.551123:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8622 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.551145:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.551159:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.551198:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.551206:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8622 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.551213:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8622 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.551221:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596786.551225:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8622 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.551233:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8622 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.551247:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8e0eeac00) 00010000:00010000:0.0:1789596786.551250:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789596786.551256:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8622 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.551262:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8622 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596786.551347:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef52b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:11524:x1876527944909312:12345-192.168.202.44@tcp:54:lfs.0 Request processed in 304us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596786.551355:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 189 00000100:00100000:3.0:1789596786.562284:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596786.562331:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944909568 00000100:00100000:3.0:1789596786.562342:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944909568 00000100:00100000:3.0:1789596786.562398:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 51 00000100:00100000:3.0:1789596786.562408:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:11524:x1876527944909568:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:3.0:1789596786.562631:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:11524:x1876527944909568:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 224us (355us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789596786.562639:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 51 00010000:00010000:3.0:1789596786.587144:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596786.612676:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596786.612955:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944909824 00000100:00100000:2.0:1789596786.612967:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944909824 00000100:00100000:3.0:1789596786.613493:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 190 00000100:00100000:3.0:1789596786.613505:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:11058:x1876527944909824:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:3.0:1789596786.613531:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596786.613553:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d8629 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345025 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.613686:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d8630 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.613700:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8614 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34501e expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.613708:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d8630 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.613740:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8614 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34501e expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.613753:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8614 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34501e expref: 28 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596786.613766:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c31e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1876527964823296:192.168.202.44@tcp:104: 00000100:00100000:3.0:1789596786.614025:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652e240 going to sleep for 11 seconds 00000100:00100000:3.0:1789596786.622087:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.622325:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c31e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1876527964823296:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596786.622393:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d8630 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596786.622562:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944909952 00000100:00100000:1.0:1789596786.622571:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944909952 00010000:00010000:1.0:1789596786.622701:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8614 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34501e expref: 29 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596786.622785:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 72 00000100:00100000:1.0:1789596786.622795:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+29:2354:x1876527944909952:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596786.622844:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596786.622852:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8614 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34501e expref: 29 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.622865:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8614 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34501e expref: 29 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.622896:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8614 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34501e expref: 29 pid: 5842 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.622912:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8e0eeac00) 00010000:00010000:1.0:1789596786.622917:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d8630 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.622927:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d8630 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.622935:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d8630 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.622969:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596786.623027:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+28:2354:x1876527944909952:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 233us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596786.623100:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 72 00010000:00010000:3.0:1789596786.623323:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d8630 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.623331:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d8630 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596786.623348:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789596786.623497:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d8629 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345025 expref: 29 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.623528:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d8630 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345025 expref: 28 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.623536:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8e0eeac00) 00010000:00010000:3.0:1789596786.623539:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789596786.623541:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88400, rc 0) 00000100:00100000:3.0:1789596786.623600:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+28:11058:x1876527944909824:12345-192.168.202.44@tcp:101:bash.0 Request processed in 10087us (10922us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789596786.623607:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 190 00000100:00100000:2.0:1789596786.628924:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.629043:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944910208 00000100:00100000:0.0:1789596786.629055:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944910208 00000100:00100000:0.0:1789596786.629106:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 191 00000100:00100000:0.0:1789596786.629116:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+28:11058:x1876527944910208:12345-192.168.202.44@tcp:36:bash.0 00010000:00010000:0.0:1789596786.629398:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d863e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.629416:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d863e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.629429:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d863e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789596786.629487:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1789596786.629517:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab39faee reply state 0000000077e4251a transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d863e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596786.629526:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789596786.629581:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1789596786.629694:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+32:11058:x1876527944910208:12345-192.168.202.44@tcp:36:bash.0 Request processed in 579us (780us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1789596786.629703:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 191 00000020:00080000:0.0:1789596786.629708:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1789596786.632792:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d863e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.632809:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d863e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.632851:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d863e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.632857:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596786.632862:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d863e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.632888:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d863e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.632904:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8e0eeac00) 00010000:00010000:1.0:1789596786.632907:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596786.632912:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d863e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.632917:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d863e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596786.635247:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.636363:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944910336 00000100:00100000:0.0:1789596786.636379:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944910336 00000100:00100000:0.0:1789596786.636509:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 192 00000100:00100000:0.0:1789596786.636520:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef52a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+31:11058:x1876527944910336:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:0.0:1789596786.636546:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596786.636583:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8645 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c34502c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.636748:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8645 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34502c expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.636764:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8645 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34502c expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.636783:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8e0eeac00) 00010000:00010000:0.0:1789596786.636787:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789596786.636791:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030e00, rc 0) 00000100:00100000:0.0:1789596786.636882:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef52a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+32:11058:x1876527944910336:12345-192.168.202.44@tcp:101:bash.0 Request processed in 364us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596786.636890:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 192 00000100:00100000:2.0:1789596786.639920:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596786.640020:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944910464 00000100:00100000:1.0:1789596786.640033:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944910464 00000100:00100000:1.0:1789596786.640100:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 58 00000100:00100000:1.0:1789596786.640110:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:11058:x1876527944910464:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:1.0:1789596786.640128:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596786.640152:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ac4025c/0x8973ae90b38d864c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345033 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789596786.640178:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aab1470, atime: 0x6aab146f, ctime: 0x6aab1470, blocks: 0xb 00010000:00010000:1.0:1789596786.640198:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=371s v=(0 0) 00010000:00010000:1.0:1789596786.640203:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596786.640211:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ac4025c/0x8973ae90b38d864c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345033 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.640227:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ac4025c/0x8973ae90b38d864c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345033 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.640272:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a33800, rc 0) 00000100:00100000:1.0:1789596786.640337:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:11058:x1876527944910464:12345-192.168.202.44@tcp:101:bash.0 Request processed in 228us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596786.640345:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 58 00000100:00100000:1.0:1789596786.642690:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596786.642797:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944910592 00000100:00100000:2.0:1789596786.642809:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944910592 00002000:00010000:2.0:1789596786.642880:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1789596786.642886:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea7c351d180 with x1876527944910592 ext(0->18446744073709551615) 00002000:00010000:2.0:1789596786.642898:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ea7c351d180. 00000100:00100000:2.0:1789596786.642925:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 5 00000100:00100000:2.0:1789596786.642935:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea7c351d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2353:x1876527944910592:12345-192.168.202.44@tcp:10:bash.0 00002000:00010000:2.0:1789596786.643293:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789596786.643297:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789596784 -> 1789596786 00002000:00010000:2.0:1789596786.643308:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789596783 -> 1789596783 00002000:00010000:2.0:1789596786.643310:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789596784 -> 1789596786 00002000:00010000:2.0:1789596786.643313:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789596786.643377:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea7c351d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:2353:x1876527944910592:12345-192.168.202.44@tcp:10:bash.0 Request processed in 443us (700us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789596786.643385:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 5 00002000:00010000:2.0:1789596786.643388:0:6700:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1789596786.643391:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea7c351d180 with x1876527944910592 ext(0->18446744073709551615) 00002000:00010000:2.0:1789596786.643395:0:6700:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ea7c351d180. 00000100:00100000:0.0:1789596786.715178:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964823424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596786.715250:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596786.715506:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964823424 00000100:00100000:2.0:1789596786.715515:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964823424 00000100:00100000:2.0:1789596786.715574:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789596786.715584:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876527964823424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596786.715619:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1789596786.715674:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876527964823424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596786.715695:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789596786.715857:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964823424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596786.724339:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.724431:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944910720 00000100:00100000:0.0:1789596786.724444:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944910720 00000100:00100000:0.0:1789596786.724507:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 193 00000100:00100000:0.0:1789596786.724519:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+32:11538:x1876527944910720:12345-192.168.202.44@tcp:34:lfs.0 00010000:00010000:0.0:1789596786.724615:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8653 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.724633:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8653 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.724664:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8653 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.724682:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d865a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.724691:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d865a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.724698:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d865a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725368:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8661 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725379:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725387:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789596786.725430:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725441:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8653 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725447:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8653 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725454:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8653 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725471:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596786.725475:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8653 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725483:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8653 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725495:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:0.0:1789596786.725498:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596786.725503:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8653 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725508:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d8653 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725523:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d865a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725528:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d865a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725533:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d865a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725538:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596786.725541:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d865a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725546:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d865a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725562:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ea8d55e5300) 00010000:00010000:0.0:1789596786.725564:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596786.725567:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d865a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725573:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d865a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725603:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8661 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725610:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8661 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725616:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8661 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725621:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596786.725623:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8661 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725629:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8661 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725635:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8e0eeac00) 00010000:00010000:0.0:1789596786.725638:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596786.725641:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8661 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.725646:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8661 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596786.725747:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+32:11538:x1876527944910720:12345-192.168.202.44@tcp:34:lfs.0 Request processed in 1227us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596786.725756:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 193 00000100:00100000:3.0:1789596786.761175:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.761359:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944910976 00000100:00100000:0.0:1789596786.761371:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944910976 00000100:00100000:0.0:1789596786.761432:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 194 00000100:00100000:0.0:1789596786.761442:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+32:11541:x1876527944910976:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789596786.761461:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596786.761480:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8668 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c34503a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.761550:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d866f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.761563:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d866f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.761574:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d866f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.761588:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8676 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.761595:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.761601:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.761918:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d867d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.761929:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d867d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.761935:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d867d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596786.761945:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789596786.762057:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d866f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.762065:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d866f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.762072:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d866f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.762078:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596786.762082:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d866f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.762090:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d866f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.762102:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:0.0:1789596786.762105:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596786.762110:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d866f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.762128:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d866f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.762144:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8676 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.762151:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8676 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.762157:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8676 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.762161:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596786.762165:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8676 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.762171:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8676 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.762179:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ea8d55e5300) 00010000:00010000:0.0:1789596786.762181:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596786.762184:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8676 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.762189:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8676 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.762234:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8668 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34503a expref: 35 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.762250:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d867d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34503a expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.762264:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8e0eeac00) 00010000:00010000:0.0:1789596786.762266:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789596786.762269:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030c00, rc 0) 00000100:00100000:0.0:1789596786.762360:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+34:11541:x1876527944910976:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 919us (1197us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1789596786.762368:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 194 00000100:00100000:1.0:1789596786.765926:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596786.766151:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944911104 00000100:00100000:2.0:1789596786.766161:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944911104 00000100:00100000:2.0:1789596786.766223:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 195 00000100:00100000:2.0:1789596786.766233:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea7c351ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+34:11541:x1876527944911104:12345-192.168.202.44@tcp:54:lfs.0 00010000:00010000:2.0:1789596786.766320:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d868b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.766337:0:10902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d8630 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345025 expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.766348:0:10902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d868b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.766387:0:10902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d8630 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345025 expref: 34 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.766401:0:10902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d8630 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345025 expref: 34 pid: 5841 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596786.766416:0:10902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef528000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10902:1876527964823552:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789596786.766513:0:10902:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6912480 going to sleep for 11 seconds 00000100:00100000:3.0:1789596786.771691:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596786.771863:0:10902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef528000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10902:1876527964823552:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789596786.771895:0:10902:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d868b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596786.771976:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944911360 00000100:00100000:0.0:1789596786.771984:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944911360 00000100:00100000:0.0:1789596786.772052:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 52 00000100:00100000:0.0:1789596786.772062:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+35:5590:x1876527944911360:12345-192.168.202.44@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789596786.772378:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+36:5590:x1876527944911360:12345-192.168.202.44@tcp:35:ldlm_bl.0 Request processed in 316us (695us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1789596786.772385:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 52 00000100:00100000:3.0:1789596786.774537:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596786.774653:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944911488 00000100:00100000:2.0:1789596786.774679:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944911488 00010000:00010000:2.0:1789596786.774717:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d8630 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345025 expref: 36 pid: 5841 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596786.774760:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 73 00000100:00100000:2.0:1789596786.774770:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+36:2354:x1876527944911488:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596786.774785:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596786.774791:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d8630 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345025 expref: 36 pid: 5841 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.774805:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d8630 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345025 expref: 36 pid: 5841 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.774863:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d8630 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345025 expref: 36 pid: 5841 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.774880:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8e0eeac00) 00010000:00010000:2.0:1789596786.774885:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d868b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.774894:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d868b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.774904:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d868b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.774927:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596786.774972:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+35:2354:x1876527944911488:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 203us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596786.774988:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 73 00010000:00010000:3.0:1789596786.775176:0:10902:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d868b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.775184:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d868b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.775211:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d868b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.775218:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d868b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.775225:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d868b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.775241:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596786.775246:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d868b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.775254:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d868b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.775263:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8e0eeac00) 00010000:00010000:3.0:1789596786.775266:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789596786.775269:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d868b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.775276:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d868b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596786.775328:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea7c351ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+34:11541:x1876527944911104:12345-192.168.202.44@tcp:54:lfs.0 Request processed in 9096us (9413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596786.775336:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 195 00000100:00100000:1.0:1789596786.777621:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.777721:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944911744 00000100:00100000:0.0:1789596786.777732:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944911744 00000100:00100000:0.0:1789596786.777799:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 53 00000100:00100000:0.0:1789596786.777810:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea7c351d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+34:11541:x1876527944911744:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:0.0:1789596786.778090:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea7c351d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+35:11541:x1876527944911744:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 282us (477us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789596786.778098:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 53 00000100:00100000:3.0:1789596786.863062:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.863177:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944912000 00000100:00100000:0.0:1789596786.863188:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944912000 00000100:00100000:0.0:1789596786.863255:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 196 00000100:00100000:0.0:1789596786.863277:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+35:11551:x1876527944912000:12345-192.168.202.44@tcp:101:cat.0 00010000:00010000:0.0:1789596786.863357:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596786.863380:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8692 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345041 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.863448:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8699 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.863465:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8699 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.863477:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8699 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.863492:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d86a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.863500:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d86a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.863507:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d86a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.863786:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d86a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.863796:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d86a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.863803:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d86a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596786.863813:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789596786.863952:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8699 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.863961:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8699 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.863968:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8699 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.863974:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596786.863978:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8699 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.863985:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8699 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.863997:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:0.0:1789596786.864000:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596786.864005:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8699 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.864011:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483c00/0x8973ae90b38d8699 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.864024:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d86a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.864030:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d86a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.864036:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d86a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.864041:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596786.864050:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d86a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.864056:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d86a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.864064:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ea8d55e5300) 00010000:00010000:0.0:1789596786.864067:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596786.864070:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d86a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.864075:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483200/0x8973ae90b38d86a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.864115:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1483600/0x8973ae90b38d8692 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345041 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.864129:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d86a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345041 expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.864137:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8e0eeac00) 00010000:00010000:0.0:1789596786.864139:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596786.864142:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ff4e6000, rc 0) 00000100:00100000:0.0:1789596786.864216:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+37:11551:x1876527944912000:12345-192.168.202.44@tcp:101:cat.0 Request processed in 941us (1162us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1789596786.864223:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 196 00000100:00100000:2.0:1789596786.869690:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.869773:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944912256 00000100:00100000:0.0:1789596786.869784:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944912256 00000100:00100000:0.0:1789596786.869870:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 54 00000100:00100000:0.0:1789596786.869881:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+37:11551:x1876527944912256:12345-192.168.202.44@tcp:35:cat.0 00000100:00100000:0.0:1789596786.870187:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+38:11551:x1876527944912256:12345-192.168.202.44@tcp:35:cat.0 Request processed in 307us (507us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789596786.870195:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 54 00000100:00100000:1.0:1789596786.884744:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.885070:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944912512 00000100:00100000:0.0:1789596786.885081:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944912512 00000100:00100000:0.0:1789596786.885152:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 197 00000100:00100000:0.0:1789596786.885166:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea7c351c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+38:11553:x1876527944912512:12345-192.168.202.44@tcp:36:rm.0 00010000:00010000:0.0:1789596786.885230:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789596786.885441:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d86a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345041 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.885470:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030c00/0x8973ae90b38d867d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34503a expref: 37 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.885487:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030e00/0x8973ae90b38d8645 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34502c expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.885497:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8e0eeac00) 00010000:00010000:0.0:1789596786.885507:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596786.885527:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7000/0x8973ae90b38d86b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.885540:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7000/0x8973ae90b38d86b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.885548:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7000/0x8973ae90b38d86b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.885581:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6600/0x8973ae90b38d86bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.885604:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6600/0x8973ae90b38d86bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.885613:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6600/0x8973ae90b38d86bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.885960:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.885969:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.885977:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789596786.886908:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1789596786.886920:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 371851103386ns, next at 372851100782ns, rc = 0 00010000:00010000:0.0:1789596786.886987:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7600/0x8973ae90b38d86ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.886998:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7600/0x8973ae90b38d86ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.887008:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7600/0x8973ae90b38d86ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.887016:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7600/0x8973ae90b38d86ca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.887237:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7600/0x8973ae90b38d86ca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.887243:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7600/0x8973ae90b38d86ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.887404:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596786.887431:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.887438:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86c3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.887443:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.887449:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596786.887453:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.887461:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86c3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.887472:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d55e5500) 00010000:00010000:0.0:1789596786.887475:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789596786.887479:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86c3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.887484:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86c3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.887502:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7000/0x8973ae90b38d86b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.887515:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7000/0x8973ae90b38d86b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.887521:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7000/0x8973ae90b38d86b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.887526:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596786.887529:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7000/0x8973ae90b38d86b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.887535:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7000/0x8973ae90b38d86b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.887543:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:0.0:1789596786.887545:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596786.887548:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7000/0x8973ae90b38d86b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.887554:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7000/0x8973ae90b38d86b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789596786.887564:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007acb15df reply state 0000000069761ddd transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6600/0x8973ae90b38d86bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596786.887575:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789596786.887772:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea7c351c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+37:11553:x1876527944912512:12345-192.168.202.44@tcp:36:rm.0 Request processed in 2606us (3035us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789596786.887781:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 197 00010000:00010000:1.0:1789596786.889357:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789596786.889370:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7600/0x8973ae90b38d86ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.889379:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7600 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:1.0:1789596786.889384:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7600/0x8973ae90b38d86ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.889392:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7600/0x8973ae90b38d86ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.889408:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ea8d55e5500) 00010000:00010000:1.0:1789596786.889411:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789596786.889415:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7600/0x8973ae90b38d86ca lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.889421:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7600/0x8973ae90b38d86ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.889447:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596786.889462:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596786.889463:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596786.891233:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6600/0x8973ae90b38d86bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.891249:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6600/0x8973ae90b38d86bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.891266:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6600/0x8973ae90b38d86bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.891273:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596786.891277:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6600/0x8973ae90b38d86bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.891309:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6600/0x8973ae90b38d86bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.891325:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ea8d55e5300) 00010000:00010000:3.0:1789596786.891328:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596786.891333:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6600/0x8973ae90b38d86bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596786.891339:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6600/0x8973ae90b38d86bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596786.948051:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.948258:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944912768 00000100:00100000:0.0:1789596786.948269:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944912768 00000100:00100000:0.0:1789596786.948366:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 198 00000100:00100000:0.0:1789596786.948377:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea7c351ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+36:11559:x1876527944912768:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:0.0:1789596786.948406:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596786.948430:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7000/0x8973ae90b38d86d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345048 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.948550:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.948565:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.948577:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.948604:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d86df lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.948612:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d86df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.948620:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d86df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789596786.950286:0:5841:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1789596786.950503:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d86e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.950518:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d86e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.950531:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d86e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.950586:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.951199:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.951207:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.951214:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596786.951219:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.951227:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.951241:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:0.0:1789596786.951244:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596786.951249:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.951256:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7200/0x8973ae90b38d86d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789596786.951281:0:5841:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce808c68 reply state 00000000d3772c81 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d86df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596786.951291:0:5841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789596786.951347:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7000/0x8973ae90b38d86d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345048 expref: 39 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.951377:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d86e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345048 expref: 38 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.951385:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d55e5600) 00010000:00010000:0.0:1789596786.951387:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596786.951390:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ff4e7c00, rc 0) 00000100:00100000:0.0:1789596786.951467:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea7c351ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+39:11559:x1876527944912768:12345-192.168.202.44@tcp:101:bash.0 Request processed in 3091us (3432us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789596786.951477:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 198 00010000:00010000:2.0:1789596786.953954:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d86df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.953974:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d86df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.953983:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d86df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.953989:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596786.953994:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d86df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.954003:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d86df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.954022:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ea8d55e5e00) 00010000:00010000:2.0:1789596786.954026:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596786.954030:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d86df lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596786.954048:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d86df lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596786.956979:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.957194:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944912896 00000100:00100000:0.0:1789596786.957205:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944912896 00000100:00100000:0.0:1789596786.957267:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 59 00000100:00100000:0.0:1789596786.957277:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea7c351f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2351:x1876527944912896:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:0.0:1789596786.957306:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596786.957327:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001df1bbfd/0x8973ae90b38d86f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c34504f expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789596786.957356:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596786.957375:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=371s v=(0 0) 00010000:00010000:0.0:1789596786.957379:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596786.957390:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001df1bbfd/0x8973ae90b38d86f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34504f expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.957409:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001df1bbfd/0x8973ae90b38d86f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34504f expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.957447:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ff4e7000, rc 0) 00000100:00100000:0.0:1789596786.957515:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea7c351f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2351:x1876527944912896:12345-192.168.202.44@tcp:101:bash.0 Request processed in 239us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596786.957522:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 59 00000100:00100000:1.0:1789596786.961461:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.961574:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944913024 00000100:00100000:0.0:1789596786.961585:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944913024 00000100:00100000:0.0:1789596786.961661:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 60 00000100:00100000:0.0:1789596786.961672:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea7c351df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:11559:x1876527944913024:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:0.0:1789596786.961694:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596786.961713:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030166696/0x8973ae90b38d86fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345056 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.961750:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001df1bbfd/0x8973ae90b38d86f4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34504f expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.961760:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596786.961764:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596786.961769:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030166696/0x8973ae90b38d86fb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345056 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.961802:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001df1bbfd/0x8973ae90b38d86f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34504f expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.961857:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001df1bbfd/0x8973ae90b38d86f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34504f expref: 7 pid: 6695 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596786.961893:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5048e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1876527964823680:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789596786.961998:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ef49db40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596786.965076:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596786.965232:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944913152 00000100:00100000:1.0:1789596786.965243:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944913152 00010000:00010000:1.0:1789596786.965320:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001df1bbfd/0x8973ae90b38d86f4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34504f expref: 8 pid: 6695 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596786.965363:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 74 00000100:00100000:1.0:1789596786.965373:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2354:x1876527944913152:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596786.965387:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596786.965414:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001df1bbfd/0x8973ae90b38d86f4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34504f expref: 8 pid: 6695 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.965428:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001df1bbfd/0x8973ae90b38d86f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34504f expref: 8 pid: 6695 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.965453:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596786.965457:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596786.965465:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030166696/0x8973ae90b38d86fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345056 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.965476:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030166696/0x8973ae90b38d86fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345056 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596786.965534:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000030166696/0x8973ae90b38d86fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345056 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596786.965549:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea7c351f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1876527964823808:192.168.202.44@tcp:105: 00000100:00100000:1.0:1789596786.965645:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c905cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596786.967788:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea7c351f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1876527964823808:192.168.202.44@tcp:105: 00010000:00010000:2.0:1789596786.967844:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596786.967898:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2354:x1876527944913152:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 2525us (2833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596786.967927:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 74 00010000:00010000:0.0:1789596786.968742:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001df1bbfd/0x8973ae90b38d86f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34504f expref: 7 pid: 6695 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596786.968764:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5048e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1876527964823680:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596786.968791:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030166696/0x8973ae90b38d86fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345056 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596786.968805:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ff4e7200, rc 0) 00000100:00100000:0.0:1789596786.968973:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea7c351df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:11559:x1876527944913024:12345-192.168.202.44@tcp:101:bash.0 Request processed in 7302us (7525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596786.968982:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 60 00000100:00100000:1.0:1789596786.978410:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596786.978522:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944913408 00000100:00100000:0.0:1789596786.978534:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944913408 00000100:00100000:0.0:1789596786.978637:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 55 00000100:00100000:0.0:1789596786.978648:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea7c351c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+38:11559:x1876527944913408:12345-192.168.202.44@tcp:35:bash.0 00000100:00100000:0.0:1789596786.979071:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea7c351c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+39:11559:x1876527944913408:12345-192.168.202.44@tcp:35:bash.0 Request processed in 423us (670us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789596786.979080:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 55 00000100:00100000:2.0:1789596787.150518:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596787.150952:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944913536 00000100:00100000:3.0:1789596787.150963:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944913536 00000100:00100000:3.0:1789596787.151136:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 199 00000100:00100000:3.0:1789596787.151149:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+39:11575:x1876527944913536:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:3.0:1789596787.151176:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596787.151199:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d8702 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c34505d expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.151268:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d8709 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.151282:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d8709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.151307:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d8709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596787.151360:0:10902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789596787.151364:0:10902:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789596787.151382:0:10902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d8709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.151408:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d8702 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34505d expref: 41 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.151427:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d8709 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34505d expref: 40 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.151437:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:3.0:1789596787.151440:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789596787.151444:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89200, rc 0) 00000100:00100000:3.0:1789596787.151563:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+40:11575:x1876527944913536:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 417us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596787.151570:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 199 00000100:00100000:2.0:1789596787.161165:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596787.161463:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944913792 00000100:00100000:0.0:1789596787.161475:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944913792 00000100:00100000:0.0:1789596787.161539:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 200 00000100:00100000:0.0:1789596787.161566:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+40:11575:x1876527944913792:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789596787.161587:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596787.161607:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7000/0x8973ae90b38d8710 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345064 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.161707:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d8717 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.161721:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d8717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.161734:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d8717 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596787.161745:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789596787.161912:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7000/0x8973ae90b38d8710 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345064 expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.161930:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d8717 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345064 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.161939:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d55e5600) 00010000:00010000:0.0:1789596787.161942:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789596787.161946:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ff4e7e00, rc 0) 00000100:00100000:0.0:1789596787.162008:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+42:11575:x1876527944913792:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 447us (855us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1789596787.162015:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 200 00000100:00100000:3.0:1789596787.167714:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596787.168254:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944914048 00000100:00100000:0.0:1789596787.168276:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944914048 00000100:00100000:0.0:1789596787.168365:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 201 00000100:00100000:0.0:1789596787.168375:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+42:11575:x1876527944914048:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789596787.168401:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596787.168422:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6400/0x8973ae90b38d8725 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c34506b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.168537:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7800/0x8973ae90b38d872c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.168552:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7800/0x8973ae90b38d872c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.168565:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7800/0x8973ae90b38d872c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596787.168578:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789596787.168698:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6400/0x8973ae90b38d8725 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34506b expref: 45 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.168718:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7800/0x8973ae90b38d872c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34506b expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.168727:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d55e5600) 00010000:00010000:0.0:1789596787.168730:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789596787.168734:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ff4e7800, rc 0) 00000100:00100000:0.0:1789596787.168790:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+44:11575:x1876527944914048:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 417us (1089us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1789596787.168813:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 201 00000100:00100000:2.0:1789596787.177931:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596787.178218:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944914176 00000100:00100000:1.0:1789596787.178228:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944914176 00000100:00100000:1.0:1789596787.178418:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 14 00000100:00100000:1.0:1789596787.178430:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3033800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+44:2351:x1876527944914176:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596787.178448:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596787.178473:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d8717 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345064 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.178492:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d55e5600) 00010000:00010000:1.0:1789596787.178497:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596787.178559:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3033800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+43:2351:x1876527944914176:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 131us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596787.178566:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 14 00000100:00100000:2.0:1789596787.185276:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596787.185399:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944914304 00000100:00100000:0.0:1789596787.185427:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944914304 00000100:00100000:0.0:1789596787.185500:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 61 00000100:00100000:0.0:1789596787.185511:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+6:2354:x1876527944914304:12345-192.168.202.44@tcp:1:lfs.0 00010000:00010000:0.0:1789596787.185555:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d551dfb1/0x8973ae90b38d873a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.185575:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000030166696/0x8973ae90b38d86fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345056 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.185583:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789596787.185587:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789596787.185592:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d551dfb1/0x8973ae90b38d873a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.185623:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000030166696/0x8973ae90b38d86fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345056 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.185636:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000030166696/0x8973ae90b38d86fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345056 expref: 6 pid: 6692 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596787.185651:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5048e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876527964823936:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789596787.185747:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ef49db40 going to sleep for 11 seconds 00000100:00080000:1.0:1789596787.185844:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789596787.189402:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596787.189520:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944914432 00000100:00100000:2.0:1789596787.189532:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944914432 00002000:00100000:2.0:1789596787.189592:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ea8fa1c5c00 x1876527944914432/t0(0) o4->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:668/0 lens 504/0 e 0 to 0 dl 1789596798 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789596787.189603:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8fa1c5c00 with x1876527944914432 ext(0->8) 00010000:00010000:2.0:1789596787.189614:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000030166696/0x8973ae90b38d86fb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345056 expref: 7 pid: 6692 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.189632:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000030166696/0x8973ae90b38d86fb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345056 expref: 7 pid: 6692 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789596787.189640:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ea8fa1c5c00 00000100:00100000:2.0:1789596787.189676:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 3 00000100:00100000:2.0:1789596787.189686:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2354:x1876527944914432:12345-192.168.202.44@tcp:4:lfs.0 00000100:00100000:2.0:1789596787.190266:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:2354:x1876527944914432:12345-192.168.202.44@tcp:4:lfs.0 Request processed in 578us (876us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789596787.190274:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 3 00002000:00100000:2.0:1789596787.190282:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ea8fa1c5c00 x1876527944914432/t4294967308(0) o4->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:668/0 lens 504/448 e 0 to 0 dl 1789596798 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789596787.190290:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8fa1c5c00 with x1876527944914432 ext(0->8) 00010000:00010000:2.0:1789596787.190317:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000030166696/0x8973ae90b38d86fb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345056 expref: 9 pid: 6692 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.190330:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000030166696/0x8973ae90b38d86fb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345056 expref: 9 pid: 6692 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789596787.190336:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ea8fa1c5c00 00000100:00100000:0.0:1789596787.190762:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5048e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876527964823936:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596787.190789:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d551dfb1/0x8973ae90b38d873a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596787.193657:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596787.193777:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944914560 00000100:00100000:1.0:1789596787.193789:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944914560 00010000:00010000:1.0:1789596787.193886:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000030166696/0x8973ae90b38d86fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345056 expref: 9 pid: 6692 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596787.193950:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 75 00000100:00100000:1.0:1789596787.193961:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d5fac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:2353:x1876527944914560:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596787.193976:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789596787.193997:0:7644:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789596787.194000:0:7644:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789596786 00002000:00010000:1.0:1789596787.194003:0:7644:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789596787 00002000:00010000:1.0:1789596787.194005:0:7644:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789596786 00010000:00010000:1.0:1789596787.194011:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000030166696/0x8973ae90b38d86fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345056 expref: 9 pid: 6692 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.194034:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000030166696/0x8973ae90b38d86fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345056 expref: 9 pid: 6692 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.194059:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030166696/0x8973ae90b38d86fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345056 expref: 9 pid: 6692 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.194076:0:7644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789596787.194080:0:7644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789596787.194086:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d551dfb1/0x8973ae90b38d873a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.194095:0:7644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d551dfb1/0x8973ae90b38d873a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.194123:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596787.194187:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d5fac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2353:x1876527944914560:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 228us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596787.194194:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 75 00010000:00010000:0.0:1789596787.194811:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d551dfb1/0x8973ae90b38d873a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.194852:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d551dfb1/0x8973ae90b38d873a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.194880:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d551dfb1/0x8973ae90b38d873a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.194889:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d551dfb1/0x8973ae90b38d873a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.194898:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d551dfb1/0x8973ae90b38d873a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.194905:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6400 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596787.194910:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d551dfb1/0x8973ae90b38d873a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.194918:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d551dfb1/0x8973ae90b38d873a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.194932:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d551dfb1/0x8973ae90b38d873a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.194956:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d551dfb1/0x8973ae90b38d873a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596787.195021:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2354:x1876527944914304:12345-192.168.202.44@tcp:1:lfs.0 Request processed in 9510us (9773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596787.195040:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 61 00000100:00100000:3.0:1789596787.204360:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596787.204555:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944914816 00000100:00100000:0.0:1789596787.204572:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944914816 00000100:00100000:0.0:1789596787.204642:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 56 00000100:00100000:0.0:1789596787.204654:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3552850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+43:11575:x1876527944914816:12345-192.168.202.44@tcp:35:lfs.0 00000004:00010000:0.0:1789596787.204734:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7800/0x8973ae90b38d872c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34506b expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789596787.205036:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1789596787.205083:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1789596787.205702:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1789596787.205767:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6400/0x8973ae90b38d8741 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.205785:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d86e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345048 expref: 47 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.205795:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6400/0x8973ae90b38d8741 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.205868:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d86e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345048 expref: 47 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.205910:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d86e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345048 expref: 47 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596787.205926:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5048e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1876527964824064:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789596787.206016:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ef49d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596787.219616:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596787.219725:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5048e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5845:1876527964824064:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596787.219753:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6400/0x8973ae90b38d8741 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596787.220072:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944914944 00000100:00100000:2.0:1789596787.220081:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944914944 00010000:00010000:2.0:1789596787.220120:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d86e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345048 expref: 48 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596787.220159:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 76 00000100:00100000:2.0:1789596787.220168:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea7c351c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+48:2354:x1876527944914944:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596787.220184:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596787.220192:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d86e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345048 expref: 48 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.220204:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d86e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345048 expref: 48 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.220225:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d86e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345048 expref: 48 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.220241:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d55e5600) 00010000:00010000:2.0:1789596787.220246:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6400/0x8973ae90b38d8741 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.220287:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6400/0x8973ae90b38d8741 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.220305:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6400/0x8973ae90b38d8741 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.220394:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596787.220461:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea7c351c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+47:2354:x1876527944914944:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 293us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596787.220469:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 76 00010000:00010000:3.0:1789596787.222223:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6400/0x8973ae90b38d8741 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.222240:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6400/0x8973ae90b38d8741 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789596787.222405:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1789596787.222628:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1789596787.222752:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900245f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1876527964824192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789596787.222853:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596787.222885:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6a03cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596787.223085:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964824192 00000100:00100000:1.0:1789596787.223093:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964824192 00000100:00100000:1.0:1789596787.223158:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789596787.223167:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1876527964824192:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:2.0:1789596787.223333:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596787.223384:0:5845:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1789596787.223390:0:5845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1789596787.223408:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ea8c5048a80, transno 4294967307 00000100:00100000:2.0:1789596787.223421:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900245f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1876527964824192:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789596787.223892:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1789596787.223956:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c3030a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1876527964824320:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789596787.224035:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1876527964824192:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 867us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596787.224044:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789596787.229922:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596787.230018:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f69123c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596787.230388:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea7c351fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964824576:0@lo:400:kworker.0 00000100:00100000:1.0:1789596787.230439:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596787.230467:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596787.230473:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea7c351e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964824704:0@lo:400:kworker.0 00000100:00100000:1.0:1789596787.230497:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596787.230529:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964824576 00000100:00100000:1.0:1789596787.230538:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964824576 00000100:00100000:1.0:1789596787.230583:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964824704 00000100:00100000:1.0:1789596787.230586:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964824704 00000100:00100000:3.0:1789596787.233068:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea7c351e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964824832:0@lo:400:kworker.0 00000100:00100000:3.0:1789596787.233149:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596787.233193:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789596787.233201:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea7c351ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964824448:0@lo:400:kworker.0 00000100:00100000:3.0:1789596787.233231:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596787.233289:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea7c351f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964824960:0@lo:400:kworker.0 00000100:00100000:3.0:1789596787.233327:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596787.233364:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964824960 00000100:00100000:3.0:1789596787.233372:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964824960 00000100:00100000:3.0:1789596787.233423:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789596787.233432:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964824576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596787.233501:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964824576:12345-0@lo:400:kworker.0 Request processed in 70us (3061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596787.233508:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789596787.233526:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789596787.233531:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876527964824960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596787.233560:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876527964824960:12345-0@lo:400:kworker.0 Request processed in 29us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596787.233566:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789596787.233603:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea7c351f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964824960:0@lo:400:kworker.0 00000100:00100000:1.0:1789596787.233995:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea7c351fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964824576:0@lo:400:kworker.0 00000100:00100000:1.0:1789596787.234067:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789596787.234075:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964824704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596787.234119:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964824704:12345-0@lo:400:kworker.0 Request processed in 45us (3621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596787.234125:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789596787.234149:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea7c351e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964824704:0@lo:400:kworker.0 00000100:00100000:1.0:1789596787.234224:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964824448 00000100:00100000:1.0:1789596787.234228:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964824448 00000100:00100000:1.0:1789596787.234430:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789596787.234438:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964824448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596787.234477:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3308:x1876527964824448:12345-0@lo:400:kworker.0 Request processed in 40us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596787.234483:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789596787.234520:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea7c351ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964824448:0@lo:400:kworker.0 00000100:00100000:2.0:1789596787.235213:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964824832 00000100:00100000:2.0:1789596787.235223:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964824832 00000100:00100000:2.0:1789596787.235272:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789596787.235280:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1876527964824832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596787.235341:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1876527964824832:12345-0@lo:400:kworker.0 Request processed in 63us (2192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596787.235346:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1789596787.235362:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789596787.235375:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596787.235401:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea7c351e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964824832:0@lo:400:kworker.0 00000100:00100000:0.0:1789596787.240192:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964824320 00000100:00100000:0.0:1789596787.240212:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964824320 00000100:00100000:0.0:1789596787.240314:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789596787.240325:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1876527964824320:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789596787.240602:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1876527964824320:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 279us (10689us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789596787.240610:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789596787.240870:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c3030a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5845:1876527964824320:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789596787.240935:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1789596787.240976:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6400/0x8973ae90b38d8741 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.240987:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6400/0x8973ae90b38d8741 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.240996:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6400/0x8973ae90b38d8741 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.241002:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596787.241007:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6400/0x8973ae90b38d8741 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.241015:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6400/0x8973ae90b38d8741 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.242536:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d55e5600) 00010000:00010000:2.0:1789596787.242546:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789596787.242555:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6400/0x8973ae90b38d8741 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.242564:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6400/0x8973ae90b38d8741 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789596787.242833:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789596787.242924:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1789596787.242935:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 372207118082ns, next at 373207115327ns, rc = 0 00000001:00080000:2.0:1789596787.242959:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1789596787.243010:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d55e5600) 00010000:00010000:2.0:1789596787.243013:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789596787.243021:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7800/0x8973ae90b38d872c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34506b expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596787.243162:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3552850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+50:11575:x1876527944914816:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 38509us (38811us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1789596787.243171:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 56 00000020:00080000:2.0:1789596787.243177:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789596787.246275:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596787.246447:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944915072 00000100:00100000:3.0:1789596787.246459:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944915072 00000100:00100000:3.0:1789596787.246534:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 202 00000100:00100000:3.0:1789596787.246544:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+50:11575:x1876527944915072:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:3.0:1789596787.246573:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596787.246597:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d8748 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345072 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.246659:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d8748 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345072 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.246675:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d8748 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345072 expref: 51 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.246695:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:3.0:1789596787.246698:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789596787.246702:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89e00, rc 0) 00000100:00100000:3.0:1789596787.246764:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+51:11575:x1876527944915072:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 222us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596787.246771:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 202 00000100:00100000:0.0:1789596787.252125:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596787.256158:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944915328 00000100:00100000:2.0:1789596787.256176:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944915328 00000100:00100000:2.0:1789596787.256269:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 57 00000100:00100000:2.0:1789596787.256281:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+51:11575:x1876527944915328:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:2.0:1789596787.256543:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+52:11575:x1876527944915328:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 263us (4426us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1789596787.256551:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 57 00000100:00100000:2.0:1789596787.377135:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596787.377228:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944915456 00000100:00100000:1.0:1789596787.377238:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944915456 00000100:00100000:1.0:1789596787.377320:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 203 00000100:00100000:1.0:1789596787.377331:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+52:11585:x1876527944915456:12345-192.168.202.44@tcp:34:lfs.0 00010000:00010000:1.0:1789596787.377407:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d874f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377424:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d874f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377436:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d874f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377452:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8756 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377460:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377467:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377605:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d875d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377614:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d875d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377621:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d875d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789596787.377669:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d875d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377682:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d874f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377690:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d874f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377698:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d874f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377704:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a33200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596787.377719:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d874f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377727:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d874f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377740:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:1.0:1789596787.377743:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596787.377748:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d874f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377762:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d874f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377775:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8756 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377781:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8756 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377787:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8756 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377792:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a33400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596787.377795:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8756 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377801:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8756 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377810:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ea8c36d5900) 00010000:00010000:1.0:1789596787.377812:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596787.377873:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8756 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377881:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8756 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377898:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d875d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377904:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d875d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377915:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d875d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377921:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596787.377923:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d875d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377929:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d875d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377936:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:1.0:1789596787.377939:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596787.377942:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d875d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.377947:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d875d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596787.378038:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+52:11585:x1876527944915456:12345-192.168.202.44@tcp:34:lfs.0 Request processed in 709us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596787.378046:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 203 00000100:00100000:1.0:1789596787.441105:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596787.441203:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944915712 00000100:00100000:3.0:1789596787.441213:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944915712 00000100:00100000:3.0:1789596787.441284:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 204 00000100:00100000:3.0:1789596787.441304:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+52:11588:x1876527944915712:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:3.0:1789596787.441327:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596787.441351:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d8764 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345079 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441423:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d876b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441461:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d876b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441473:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d876b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441489:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8772 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441497:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441503:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441640:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8779 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441649:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441656:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596787.441667:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789596787.441764:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d876b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441771:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d876b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441777:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d876b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441789:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596787.441793:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d876b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441801:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d876b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441813:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:3.0:1789596787.441854:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596787.441859:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d876b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441866:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d876b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441880:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441887:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8772 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441892:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441897:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596787.441901:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441907:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8772 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441932:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ea8d1438900) 00010000:00010000:3.0:1789596787.441934:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596787.441938:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8772 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441943:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8772 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.441985:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d8764 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345079 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.442001:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8779 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345079 expref: 54 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.442008:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:3.0:1789596787.442010:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596787.442013:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89600, rc 0) 00000100:00100000:3.0:1789596787.442081:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+54:11588:x1876527944915712:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 788us (986us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789596787.442089:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 204 00000100:00100000:2.0:1789596787.446937:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596787.447908:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944915840 00000100:00100000:1.0:1789596787.447920:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944915840 00000100:00100000:1.0:1789596787.448015:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 205 00000100:00100000:1.0:1789596787.448036:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+54:11588:x1876527944915840:12345-192.168.202.44@tcp:54:lfs.0 00010000:00010000:1.0:1789596787.448108:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8787 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.448145:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8787 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.448157:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8787 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.448183:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8787 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.448189:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8787 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.448197:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8787 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.448203:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596787.448208:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8787 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.448215:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8787 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.448226:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:1.0:1789596787.448229:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789596787.448234:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8787 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.448241:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d8787 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596787.448342:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+54:11588:x1876527944915840:12345-192.168.202.44@tcp:54:lfs.0 Request processed in 317us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596787.448354:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 205 00000100:00100000:2.0:1789596787.451133:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596787.451226:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944916096 00000100:00100000:1.0:1789596787.451238:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944916096 00000100:00100000:1.0:1789596787.451399:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 58 00000100:00100000:1.0:1789596787.451410:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+54:11588:x1876527944916096:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:1.0:1789596787.451653:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3031f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+55:11588:x1876527944916096:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 245us (528us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789596787.451661:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 58 00000100:00100000:0.0:1789596787.526118:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596787.526219:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944916352 00000100:00100000:1.0:1789596787.526230:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944916352 00000100:00100000:1.0:1789596787.526309:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 206 00000100:00100000:1.0:1789596787.526321:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+55:11598:x1876527944916352:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:1.0:1789596787.526347:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596787.526350:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789596787.526380:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89200/0x8973ae90b38d8709 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34505d expref: 55 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.526401:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:1.0:1789596787.526406:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789596787.526420:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d878e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345080 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.526510:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8795 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.526522:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8779 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345079 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.526545:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8795 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.526579:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8779 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345079 expref: 55 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.526605:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8779 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345079 expref: 55 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596787.526620:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1876527964825088:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789596787.526711:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6948d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789596787.529410:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5842:1876527964825088:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596787.529441:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8795 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596787.531461:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596787.531554:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944916480 00000100:00100000:3.0:1789596787.531564:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944916480 00010000:00010000:3.0:1789596787.531605:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8779 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345079 expref: 56 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596787.531638:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 77 00000100:00100000:3.0:1789596787.531648:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5048a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+56:2353:x1876527944916480:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596787.531682:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596787.531691:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8779 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345079 expref: 56 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.531704:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8779 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345079 expref: 56 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.531726:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d8779 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345079 expref: 56 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.531744:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:3.0:1789596787.531750:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8795 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.531760:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8795 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.531768:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8795 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.531804:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596787.531888:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5048a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+55:2353:x1876527944916480:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 242us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596787.531896:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 77 00010000:00010000:0.0:1789596787.532507:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8795 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.532519:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8795 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596787.532545:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789596787.532724:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d878e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345080 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.532744:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8795 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345080 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.532752:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:0.0:1789596787.532755:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789596787.532758:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a33400, rc 0) 00000100:00100000:0.0:1789596787.532808:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+55:11598:x1876527944916352:12345-192.168.202.44@tcp:101:bash.0 Request processed in 6490us (6702us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789596787.533248:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 206 00000100:00100000:0.0:1789596787.541765:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596787.541856:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944916736 00000100:00100000:3.0:1789596787.541867:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944916736 00000100:00100000:3.0:1789596787.541932:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 207 00000100:00100000:3.0:1789596787.541943:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c504b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+55:11598:x1876527944916736:12345-192.168.202.44@tcp:36:bash.0 00010000:00010000:3.0:1789596787.542251:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d87a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.542280:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d87a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.542301:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d87a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789596787.542354:0:10902:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1789596787.542379:0:10902:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003edd18d3 reply state 00000000a8501cff transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d87a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596787.542389:0:10902:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789596787.542488:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c504b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+58:11598:x1876527944916736:12345-192.168.202.44@tcp:36:bash.0 Request processed in 546us (730us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1789596787.542496:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 207 00000020:00080000:3.0:1789596787.542501:0:10902:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789596787.547959:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596787.548063:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944916864 00000100:00100000:1.0:1789596787.548073:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944916864 00000100:00100000:1.0:1789596787.548141:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 208 00000100:00100000:1.0:1789596787.548152:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+58:11598:x1876527944916864:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:1.0:1789596787.548180:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596787.548201:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d87aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345087 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.548595:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d87b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.548611:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8795 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345080 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.548633:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d87a3 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.548641:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d87b1 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.548660:0:5841:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d87a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.548685:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8795 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345080 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.548697:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8795 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345080 expref: 59 pid: 5842 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596787.548711:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1876527964825216:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789596787.548794:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6948d80 going to sleep for 11 seconds 00010000:00010000:3.0:1789596787.551812:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d87a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.551848:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d87a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.551856:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d87a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.551863:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596787.551868:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d87a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.551876:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d87a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.551910:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:3.0:1789596787.551914:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596787.551918:0:3292:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d87b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.551930:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d87a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.551937:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d87a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596787.552483:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1876527964825216:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596787.552508:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d87b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596787.554054:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596787.554678:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944916992 00000100:00100000:3.0:1789596787.554692:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944916992 00010000:00010000:3.0:1789596787.554742:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8795 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345080 expref: 59 pid: 5842 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596787.554790:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 78 00000100:00100000:3.0:1789596787.554802:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3030380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+59:2354:x1876527944916992:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596787.554852:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596787.554861:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8795 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345080 expref: 59 pid: 5842 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.554876:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8795 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345080 expref: 59 pid: 5842 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.554899:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d8795 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345080 expref: 59 pid: 5842 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.554939:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:3.0:1789596787.554946:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d87b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.554957:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d87b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.554967:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d87b1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596787.554992:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596787.555070:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3030380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+58:2354:x1876527944916992:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 271us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596787.555086:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 78 00010000:00010000:2.0:1789596787.556195:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d87b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.556211:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d87b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596787.556304:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789596787.556309:0:5841:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789596787.556332:0:5841:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d87b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.556369:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d87aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345087 expref: 58 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.556388:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d87b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345087 expref: 57 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.556396:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:2.0:1789596787.556399:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596787.556402:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32800, rc 0) 00000100:00100000:2.0:1789596787.556479:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+57:11598:x1876527944916864:12345-192.168.202.44@tcp:101:bash.0 Request processed in 8328us (8531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596787.556487:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 208 00000100:00100000:2.0:1789596787.562502:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596787.562628:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944917248 00000100:00100000:3.0:1789596787.562640:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944917248 00000100:00100000:3.0:1789596787.562705:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 59 00000100:00100000:3.0:1789596787.562717:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+57:11598:x1876527944917248:12345-192.168.202.44@tcp:35:bash.0 00000100:00100000:3.0:1789596787.563053:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+58:11598:x1876527944917248:12345-192.168.202.44@tcp:35:bash.0 Request processed in 338us (561us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1789596787.563061:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 59 00010000:00010000:2.0:1789596787.611442:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596787.667581:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596787.667855:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944917376 00000100:00100000:0.0:1789596787.667866:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944917376 00000100:00100000:0.0:1789596787.667926:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 209 00000100:00100000:0.0:1789596787.667937:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+58:11604:x1876527944917376:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789596787.667962:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596787.667984:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7a00/0x8973ae90b38d87b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c34508e expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.668048:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7400/0x8973ae90b38d87bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.668062:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7400/0x8973ae90b38d87bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.668074:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7400/0x8973ae90b38d87bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596787.668145:0:10902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789596787.668149:0:10902:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789596787.668168:0:10902:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7400/0x8973ae90b38d87bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.668193:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7a00/0x8973ae90b38d87b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34508e expref: 60 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.668212:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7400/0x8973ae90b38d87bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34508e expref: 59 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.668221:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:0.0:1789596787.668224:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789596787.668228:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ff4e7400, rc 0) 00000100:00100000:0.0:1789596787.668303:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+59:11604:x1876527944917376:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 358us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596787.668309:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 209 00000100:00100000:0.0:1789596787.672213:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596787.672375:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944917504 00000100:00100000:1.0:1789596787.672386:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944917504 00000100:00100000:1.0:1789596787.672511:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 210 00000100:00100000:1.0:1789596787.672522:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+59:11604:x1876527944917504:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:1.0:1789596787.672542:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596787.672564:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d87c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345095 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.672664:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d87cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.672678:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d87cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.672688:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d87cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.672703:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d87d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.672710:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d87d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.672716:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d87d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.672813:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d87db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.672858:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d87db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.672866:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d87db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596787.672903:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789596787.672908:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789596787.672927:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d87db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.672951:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d87db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.672960:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d87cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.672967:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d87cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.672973:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d87cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.672979:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596787.672984:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d87cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.672991:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d87cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.673002:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:1.0:1789596787.673005:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596787.673010:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d87cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.673017:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d87cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.673031:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d87d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.673038:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d87d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.673050:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d87d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.673055:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a33000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596787.673058:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d87d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.673064:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d87d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.673072:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ea8c36d5900) 00010000:00010000:1.0:1789596787.673075:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596787.673089:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d87d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.673096:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33000/0x8973ae90b38d87d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.673129:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d87c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345095 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.673144:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d87db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345095 expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.673151:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:1.0:1789596787.673154:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789596787.673156:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32600, rc 0) 00000100:00100000:1.0:1789596787.673226:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900464000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+60:11604:x1876527944917504:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 705us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596787.673241:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 210 00000100:00100000:2.0:1789596787.676646:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596787.676739:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944917760 00000100:00100000:1.0:1789596787.676750:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944917760 00000100:00100000:1.0:1789596787.676906:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 211 00000100:00100000:1.0:1789596787.676918:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+60:11604:x1876527944917760:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:1.0:1789596787.676940:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596787.676962:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d87e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c34509c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.677088:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d87e9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.677103:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d87b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345087 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.677112:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d87db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345095 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.677120:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d87e9 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.677157:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d87db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345095 expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.677171:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d87db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345095 expref: 61 pid: 5842 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596787.677185:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964825344:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596787.677311:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d87b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345087 expref: 61 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.677320:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d87b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345087 expref: 61 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596787.677329:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8d0e8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964825472:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789596787.677354:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6948d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789596787.678887:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596787.678972:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944917888 00000100:00100000:1.0:1789596787.678982:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944917888 00010000:00010000:1.0:1789596787.679032:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d87db lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345095 expref: 62 pid: 5842 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596787.679071:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 79 00000100:00100000:1.0:1789596787.679089:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+62:2353:x1876527944917888:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596787.679102:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596787.679109:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d87db lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345095 expref: 62 pid: 5842 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.679122:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d87db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345095 expref: 62 pid: 5842 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.679142:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:1.0:1789596787.679148:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d87e9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.679156:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d87e9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.679176:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596787.679224:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900246680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+62:2353:x1876527944917888:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 146us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596787.679231:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 79 00000100:00100000:3.0:1789596787.683655:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596787.683885:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944918016 00000100:00100000:2.0:1789596787.683896:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944918016 00010000:00010000:2.0:1789596787.683947:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d87b1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345087 expref: 62 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596787.684036:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 80 00000100:00100000:2.0:1789596787.684047:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900246300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+62:2353:x1876527944918016:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596787.684094:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596787.684104:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d87b1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345087 expref: 62 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.684119:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d87b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345087 expref: 62 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.684145:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:2.0:1789596787.684150:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d87e9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.684160:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d87e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.684169:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d87e9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.684191:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596787.684257:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900246300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+62:2353:x1876527944918016:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 210us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596787.684264:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 80 00010000:00010000:1.0:1789596787.685464:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d87b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345087 expref: 61 pid: 5841 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596787.685486:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8d0e8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964825472:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596787.685504:0:5843:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.44@tcp) returned -22 from blocking AST (req@00000000e8da89bb x1876527964825344) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d87db lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345095 expref: 60 pid: 5842 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.685596:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d87db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345095 expref: 60 pid: 5842 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596787.685608:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964825344:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596787.685631:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:1.0:1789596787.685639:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d87e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.685649:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d87e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.685655:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d87e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596787.685675:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789596787.686049:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d87e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34509c expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.686066:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d87e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34509c expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596787.686074:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:1.0:1789596787.686077:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789596787.686080:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a33e00, rc 0) 00000100:00100000:1.0:1789596787.686139:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3033b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+60:11604:x1876527944917760:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 9223us (9504us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1789596787.686147:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 211 00000100:00100000:3.0:1789596787.690469:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596787.692789:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944918272 00000100:00100000:0.0:1789596787.692804:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944918272 00000100:00100000:0.0:1789596787.692902:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 15 00000100:00100000:0.0:1789596787.692913:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900246a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+60:11604:x1876527944918272:12345-192.168.202.44@tcp:103:lfs.0 00010000:00010000:0.0:1789596787.692929:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596787.692958:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89e00/0x8973ae90b38d8748 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345072 expref: 60 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.692981:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:0.0:1789596787.693000:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596787.693071:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900246a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+59:11604:x1876527944918272:12345-192.168.202.44@tcp:103:lfs.0 Request processed in 159us (2611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596787.693382:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 15 00000100:00100000:3.0:1789596787.694748:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596787.697152:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944918400 00000100:00100000:2.0:1789596787.697167:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944918400 00000100:00100000:2.0:1789596787.697235:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 212 00000100:00100000:2.0:1789596787.697246:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+59:11604:x1876527944918400:12345-192.168.202.44@tcp:58:lfs.0 00010000:00010000:2.0:1789596787.697375:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d87f7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.697390:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d87f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596787.697404:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d87f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789596787.697583:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789596787.697672:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+59:11604:x1876527944918400:12345-192.168.202.44@tcp:58:lfs.0 Request processed in 427us (2930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596787.697680:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 212 00000100:00100000:3.0:1789596787.702319:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596787.703047:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944918528 00000100:00100000:0.0:1789596787.703060:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944918528 00000100:00100000:0.0:1789596787.703134:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 213 00000100:00100000:0.0:1789596787.703144:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+59:11604:x1876527944918528:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789596787.703169:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596787.703192:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7a00/0x8973ae90b38d87fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3450a3 expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.703243:0:10902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d87f7 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.703252:0:10902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7a00/0x8973ae90b38d87fe lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450a3 expref: 60 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.703273:0:10902:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d87f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.703300:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7a00/0x8973ae90b38d87fe lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450a3 expref: 60 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.703316:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:0.0:1789596787.703319:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789596787.703323:0:10902:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7a00/0x8973ae90b38d87fe lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450a3 expref: 60 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596787.703341:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ff4e7a00, rc 0) 00000100:00100000:0.0:1789596787.703404:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+60:11604:x1876527944918528:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 261us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596787.703412:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 213 00000100:00100000:2.0:1789596787.739802:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789596787.739851:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964825600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596787.739928:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596787.740968:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964825600 00000100:00100000:3.0:1789596787.740980:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964825600 00000100:00100000:3.0:1789596787.741057:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789596787.741075:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3032680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876527964825600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789596787.741108:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596787.741341:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3032680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876527964825600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 268us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596787.741349:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789596787.741460:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964825600:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1789596788.315469:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789596788.315479:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789596788.315782:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 5 00000040:00080000:0.0:1789596788.315792:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789596788.315949:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef647100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876527964825728:192.168.202.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789596788.316061:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ef49d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596788.319616:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596788.319795:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944918656 00000100:00100000:1.0:1789596788.319804:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944918656 00000100:00100000:1.0:1789596788.319931:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 214 00000100:00100000:1.0:1789596788.319942:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+61:11605:x1876527944918656:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789596788.319975:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789596788.320088:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+61:11605:x1876527944918656:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 Request processed in 148us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596788.320096:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 214 00000100:00080000:2.0:1789596788.320329:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596788.323167:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef647100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876527964825728:192.168.202.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789596788.328926:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596788.329435:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944918784 00000100:00100000:1.0:1789596788.329448:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944918784 00000100:00100000:1.0:1789596788.329517:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 215 00000100:00100000:1.0:1789596788.329528:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+60:11605:x1876527944918784:12345-192.168.202.44@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789596788.329603:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8805 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329640:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8805 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329655:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8805 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329673:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d880c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329681:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d880c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329688:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d880c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329713:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8813 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329722:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329729:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596788.329768:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789596788.329773:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789596788.329787:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329798:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8805 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329845:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8805 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329853:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8805 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329860:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a33c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596788.329864:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8805 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329872:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8805 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329884:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ea8d55e5800) 00010000:00010000:1.0:1789596788.329887:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596788.329892:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8805 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329899:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8805 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329913:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d880c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329919:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d880c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329926:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d880c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329930:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596788.329939:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d880c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329946:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d880c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329953:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9ea8c36d5900) 00010000:00010000:1.0:1789596788.329955:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596788.329958:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d880c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329964:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d880c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329979:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329984:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8813 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329990:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8813 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.329995:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596788.329998:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8813 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.330004:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8813 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.330011:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:1.0:1789596788.330013:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596788.330022:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8813 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.330028:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8813 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596788.330435:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+60:11605:x1876527944918784:12345-192.168.202.44@tcp:34:lhsmtool_posix.0 Request processed in 905us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596788.330446:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 215 00000100:00100000:3.0:1789596788.337659:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596788.337769:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944919040 00000100:00100000:2.0:1789596788.337781:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944919040 00000100:00100000:2.0:1789596788.337878:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 216 00000100:00100000:2.0:1789596788.337889:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+60:11605:x1876527944919040:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596788.337911:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596788.337934:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d881a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3450aa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.338207:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d8821 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.338221:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d8821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.338230:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d8821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596788.338254:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789596788.338358:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d8821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.338366:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d8821 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.338373:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d8821 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.338380:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596788.338384:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d8821 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.338392:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d8821 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.338402:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:2.0:1789596788.338404:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789596788.338408:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d8821 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.338412:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d8821 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.338447:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d881a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450aa expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.338456:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ea8d55e5800) 00010000:00010000:2.0:1789596788.338458:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789596788.338469:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d881a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450aa expref: 62 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.338479:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426e00, rc 0) 00000100:00100000:2.0:1789596788.338540:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+61:11605:x1876527944919040:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 653us (891us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1789596788.338547:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 216 00000100:00100000:2.0:1789596788.342039:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596788.342151:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944919168 00000100:00100000:0.0:1789596788.342160:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944919168 00000100:00100000:0.0:1789596788.342210:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 217 00000100:00100000:0.0:1789596788.342217:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+61:11605:x1876527944919168:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789596788.342248:0:10902:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789596788.342364:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3032300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+61:11605:x1876527944919168:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 Request processed in 145us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596788.342372:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 217 00000100:00100000:3.0:1789596788.353043:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596788.354083:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944919424 00000100:00100000:1.0:1789596788.354099:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944919424 00000100:00100000:1.0:1789596788.354168:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 218 00000100:00100000:1.0:1789596788.354180:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+61:11605:x1876527944919424:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789596788.354202:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596788.354205:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789596788.354231:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7400/0x8973ae90b38d87bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34508e expref: 61 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.354253:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:1.0:1789596788.354257:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789596788.354271:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d882f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3450b1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789596788.354803:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1789596788.355041:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d8836 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.355055:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d8836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.355082:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d8836 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.355137:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d882f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450b1 expref: 63 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.355153:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d8836 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450b1 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.355160:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ea8c36d5900) 00010000:00010000:1.0:1789596788.355163:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789596788.355165:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32600, rc 0) 00000100:00100000:1.0:1789596788.355243:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+62:11605:x1876527944919424:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 1065us (2207us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1789596788.355251:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 218 00000100:00100000:3.0:1789596788.366615:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596788.366953:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944919680 00000100:00100000:0.0:1789596788.366964:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944919680 00000100:00100000:0.0:1789596788.367026:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 219 00000100:00100000:0.0:1789596788.367036:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+62:11605:x1876527944919680:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789596788.367097:0:10902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596788.367137:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d8836 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450b1 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367155:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ea8c36d5900) 00010000:00010000:0.0:1789596788.367167:0:10902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596788.367368:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8844 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367383:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8844 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367395:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8844 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367449:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d884b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x2993d643 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367458:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d884b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2993d643 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367465:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d884b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2993d643 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367531:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8844 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367539:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8844 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367546:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8844 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367552:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6a00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596788.367566:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8844 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367575:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8844 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367584:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:0.0:1789596788.367587:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596788.367590:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8844 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367598:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8844 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367608:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d884b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2993d643 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367614:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d884b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2993d643 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367619:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d884b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2993d643 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367624:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596788.367627:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d884b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2993d643 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367633:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d884b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2993d643 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367640:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x2993d643 (ffff9ea8d55e5700) 00010000:00010000:0.0:1789596788.367642:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596788.367651:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d884b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2993d643 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.367658:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d884b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2993d643 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596788.367748:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+61:11605:x1876527944919680:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 Request processed in 713us (1157us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789596788.367756:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 219 00000100:00100000:3.0:1789596788.374298:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596788.374461:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944919808 00000100:00100000:1.0:1789596788.374472:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944919808 00000100:00100000:1.0:1789596788.374536:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 220 00000100:00100000:1.0:1789596788.374548:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+61:11605:x1876527944919808:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789596788.374571:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596788.374598:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8852 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3450b8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.374637:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8859 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.374653:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.374682:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.374784:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8852 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450b8 expref: 63 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.374803:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8859 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450b8 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.374812:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ea8c36d5800) 00010000:00010000:1.0:1789596788.374866:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789596788.374870:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a33c00, rc 0) 00000100:00100000:1.0:1789596788.374930:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+62:11605:x1876527944919808:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 384us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596788.374938:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 220 00000100:00100000:3.0:1789596788.378569:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596788.382353:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944920064 00000100:00100000:0.0:1789596788.382370:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944920064 00000100:00100000:0.0:1789596788.382450:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 221 00000100:00100000:0.0:1789596788.382461:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+62:11605:x1876527944920064:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789596788.382552:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d8860 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.382570:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d8860 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.382581:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d8860 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789596788.382903:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1789596788.382914:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373347096752ns, next at 374347094014ns, rc = 0 00000004:00010000:0.0:1789596788.383016:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070b61bf2 reply state 000000000266cc35 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d8860 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596788.383026:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789596788.383613:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+64:11605:x1876527944920064:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 Request processed in 1150us (5050us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1789596788.383642:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 221 00010000:00010000:2.0:1789596788.387765:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d8860 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.387784:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d8860 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.387792:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d8860 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.387799:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596788.387803:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d8860 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.387811:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d8860 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.387876:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ea8c36d5800) 00010000:00010000:2.0:1789596788.387880:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789596788.387885:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d8860 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.387891:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d8860 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596788.391747:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596788.391921:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944920192 00000100:00100000:0.0:1789596788.391932:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944920192 00000100:00100000:0.0:1789596788.391993:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 222 00000100:00100000:0.0:1789596788.392003:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+63:11605:x1876527944920192:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789596788.392034:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596788.392055:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8867 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3450bf expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.392123:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8867 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450bf expref: 64 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.392138:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8867 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450bf expref: 64 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.392156:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ea8c36d5800) 00010000:00010000:0.0:1789596788.392160:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789596788.392163:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ff4e6a00, rc 0) 00000100:00100000:0.0:1789596788.392228:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+64:11605:x1876527944920192:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 225us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596788.392235:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 222 00000100:00100000:3.0:1789596788.402547:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596788.402979:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944920320 00000100:00100000:2.0:1789596788.402991:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944920320 00000100:00100000:2.0:1789596788.403101:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 62 00000100:00100000:2.0:1789596788.403112:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:2353:x1876527944920320:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789596788.403470:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900244000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+10:2353:x1876527944920320:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 Request processed in 359us (934us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789596788.403478:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 62 00000100:00080000:0.0:1789596788.405367:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596788.411768:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596788.413406:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944920576 00000100:00100000:2.0:1789596788.413422:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944920576 00000100:00100000:2.0:1789596788.413544:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 60 00000100:00100000:2.0:1789596788.413556:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+64:11605:x1876527944920576:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789596788.413874:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900245f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+65:11605:x1876527944920576:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 Request processed in 320us (2116us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789596788.413883:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 60 00000100:00100000:1.0:1789596788.418712:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596788.418803:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944920832 00000100:00100000:3.0:1789596788.418849:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944920832 00000100:00100000:3.0:1789596788.418913:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 223 00000100:00100000:3.0:1789596788.418923:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+65:11605:x1876527944920832:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789596788.419072:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+65:11605:x1876527944920832:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 Request processed in 150us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596788.419089:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 223 00000100:00100000:3.0:1789596788.429449:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596788.429558:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944920960 00000100:00100000:0.0:1789596788.429569:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944920960 00000100:00100000:0.0:1789596788.429633:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 224 00000100:00100000:0.0:1789596788.429644:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea7c351d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+65:11605:x1876527944920960:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789596788.429682:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596788.429704:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d886e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3450c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.429776:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7400/0x8973ae90b38d8875 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.429791:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7400/0x8973ae90b38d8875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.429803:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7400/0x8973ae90b38d8875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596788.429882:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789596788.429902:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7400/0x8973ae90b38d8875 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.429929:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6e00/0x8973ae90b38d886e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450c6 expref: 67 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.429947:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7400/0x8973ae90b38d8875 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450c6 expref: 66 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.429954:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ea8c36d5800) 00010000:00010000:0.0:1789596788.429957:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789596788.429961:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ff4e7400, rc 0) 00000100:00100000:0.0:1789596788.430011:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea7c351d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+66:11605:x1876527944920960:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 369us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596788.430030:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 224 00000100:00100000:2.0:1789596788.440719:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596788.440805:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944921088 00000100:00100000:0.0:1789596788.440835:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944921088 00000100:00100000:0.0:1789596788.440895:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 63 00000100:00100000:0.0:1789596788.440906:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+10:2354:x1876527944921088:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789596788.440923:0:9219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596788.440944:0:9219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057a25e6c/0x8973ae90b38d887c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3450cd expref: -99 pid: 9219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789596788.440972:0:9219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab1474, blocks: 0x1 00010000:00010000:0.0:1789596788.440990:0:9219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=373s v=(0 0) 00010000:00010000:0.0:1789596788.440995:0:9219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596788.441004:0:9219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057a25e6c/0x8973ae90b38d887c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450cd expref: 11 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.441033:0:9219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000057a25e6c/0x8973ae90b38d887c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450cd expref: 11 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.441045:0:9219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ff4e6e00, rc 0) 00000100:00100000:0.0:1789596788.441110:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+11:2354:x1876527944921088:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 205us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596788.441117:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 63 00000100:00100000:1.0:1789596788.455796:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596788.455924:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944921344 00000100:00100000:3.0:1789596788.455935:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944921344 00000100:00100000:3.0:1789596788.455998:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 225 00000100:00100000:3.0:1789596788.456007:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+66:11605:x1876527944921344:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789596788.456121:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+66:11605:x1876527944921344:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 Request processed in 114us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596788.456129:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 225 00000100:00100000:3.0:1789596788.467689:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596788.467790:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944921472 00000100:00100000:2.0:1789596788.467801:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944921472 00000100:00100000:2.0:1789596788.467892:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 64 00000100:00100000:2.0:1789596788.467903:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea7c351c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+11:11605:x1876527944921472:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596788.467924:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596788.467946:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097f0f852/0x8973ae90b38d8883 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3450d4 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.467984:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000057a25e6c/0x8973ae90b38d887c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450cd expref: 12 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.468008:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596788.468013:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596788.468019:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097f0f852/0x8973ae90b38d8883 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450d4 expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.468053:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000057a25e6c/0x8973ae90b38d887c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450cd expref: 12 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.468068:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000057a25e6c/0x8973ae90b38d887c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450cd expref: 12 pid: 9219 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596788.468319:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c3031c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6693:1876527964825856:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789596788.468419:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6912300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596788.471690:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c3031c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6693:1876527964825856:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596788.471732:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000097f0f852/0x8973ae90b38d8883 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450d4 expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.471755:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426c00, rc 0) 00000100:00100000:1.0:1789596788.471855:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea7c351c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+12:11605:x1876527944921472:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 3953us (4177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596788.471865:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 64 00000100:00100000:1.0:1789596788.486127:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596788.486613:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944921600 00000100:00100000:2.0:1789596788.486625:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944921600 00010000:00010000:2.0:1789596788.486675:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000057a25e6c/0x8973ae90b38d887c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450cd expref: 12 pid: 9219 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596788.486724:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 81 00000100:00100000:2.0:1789596788.486735:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d5faf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+12:2354:x1876527944921600:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596788.486750:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596788.486774:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000057a25e6c/0x8973ae90b38d887c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450cd expref: 12 pid: 9219 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.486806:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000057a25e6c/0x8973ae90b38d887c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450cd expref: 12 pid: 9219 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.486873:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057a25e6c/0x8973ae90b38d887c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450cd expref: 12 pid: 9219 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.486890:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596788.486894:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596788.486902:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000097f0f852/0x8973ae90b38d8883 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450d4 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.486912:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097f0f852/0x8973ae90b38d8883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450d4 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.486951:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000097f0f852/0x8973ae90b38d8883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450d4 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596788.486967:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c3031500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1876527964825984:192.168.202.44@tcp:105: 00000100:00100000:2.0:1789596788.487191:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f69126c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596788.497230:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c3031500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1876527964825984:192.168.202.44@tcp:105: 00010000:00010000:2.0:1789596788.497269:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596788.497338:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d5faf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+11:2354:x1876527944921600:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 10604us (11220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596788.497350:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 81 00000100:00100000:2.0:1789596788.500791:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596788.500930:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944921728 00000100:00100000:1.0:1789596788.500942:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944921728 00002000:00100000:1.0:1789596788.500995:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9ea8c3030380 x1876527944921728/t0(0) o4->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:669/0 lens 504/0 e 0 to 0 dl 1789596799 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789596788.501006:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8c3030380 with x1876527944921728 ext(0->12) 00002000:00010000:1.0:1789596788.501023:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ea8c3030380 00000100:00100000:1.0:1789596788.501055:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 6 00000100:00100000:1.0:1789596788.501065:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+11:2352:x1876527944921728:12345-192.168.202.44@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789596788.501578:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:2352:x1876527944921728:12345-192.168.202.44@tcp:4:lhsmtool_posix.0 Request processed in 512us (794us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789596788.501588:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 6 00002000:00100000:1.0:1789596788.501596:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9ea8c3030380 x1876527944921728/t4294967320(0) o4->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:669/0 lens 504/448 e 0 to 0 dl 1789596799 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789596788.501604:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8c3030380 with x1876527944921728 ext(0->12) 00002000:00010000:1.0:1789596788.501608:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ea8c3030380 00000100:00100000:1.0:1789596788.516784:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596788.516923:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944921856 00000100:00100000:0.0:1789596788.516934:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944921856 00000100:00100000:0.0:1789596788.516998:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 226 00000100:00100000:0.0:1789596788.517008:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+66:11605:x1876527944921856:12345-192.168.202.44@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1789596788.635206:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+66:11605:x1876527944921856:12345-192.168.202.44@tcp:44:lhsmtool_posix.0 Request processed in 118186us (118418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596788.635223:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 226 00000001:00080000:2.0:1789596788.637703:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:2.0:1789596788.637718:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:2.0:1789596788.637754:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1789596788.637796:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ea8c905ca80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1789596788.637802:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ea8d5fc3a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ea8c905ce40 00000020:00080000:2.0:1789596788.637805:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ea8d5fc3100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ea900651800 00000001:00080000:2.0:1789596788.637847:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1789596788.637859:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789596788.637879:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ea8f6912840 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1789596788.637888:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ea8c7f48a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ea8f6912480 00000020:00080000:2.0:1789596788.637890:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ea8c7f48c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ea8d5aa7000 00000100:00100000:3.0:1789596788.638293:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596788.638648:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944921984 00000100:00100000:1.0:1789596788.638658:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944921984 00000100:00100000:1.0:1789596788.638716:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 65 00000100:00100000:1.0:1789596788.638727:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea7c351e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:2353:x1876527944921984:12345-192.168.202.44@tcp:16:lhsmtool_posix.0 00000020:00080000:0.0:1789596788.639060:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789596788.639590:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789596788.639605:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596788.639625:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea7c351e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964826112:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789596788.639688:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789596788.639921:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596788.639937:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea7c351ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964826240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789596788.639966:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596788.639991:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789596788.639997:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c3031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964826368:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789596788.640725:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964826112 00000100:00100000:1.0:1789596788.640736:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964826112 00000100:00100000:1.0:1789596788.640781:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964826240 00000100:00100000:1.0:1789596788.640785:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964826240 00000100:00100000:1.0:1789596788.640800:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789596788.640849:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1876527964826112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789596788.640875:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1789596788.640901:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d0a2c13/0x8973ae90b38d888a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.640924:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ac4025c/0x8973ae90b38d864c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345033 expref: 13 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.640932:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789596788.640937:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789596788.640941:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d0a2c13/0x8973ae90b38d888a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.640971:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ac4025c/0x8973ae90b38d864c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345033 expref: 13 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.640986:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ac4025c/0x8973ae90b38d864c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345033 expref: 13 pid: 6692 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596788.640999:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876527964826496:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789596788.641091:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f69483c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596788.641364:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596788.641463:0:6693:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789596788.641471:0:6693:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1789596788.642639:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1789596788.642658:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964826368 00000100:00100000:1.0:1789596788.642668:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964826368 00000100:00100000:2.0:1789596788.651499:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876527964826496:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789596788.651533:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d0a2c13/0x8973ae90b38d888a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596788.652049:0:12484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789596788.652063:0:12484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3308:x1876527964826240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789596788.652308:0:12484:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789596788.652319:0:12484:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789596788 00002000:00010000:2.0:1789596788.652322:0:12484:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789596788.652324:0:12484:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789596788 -> 1789596788 00002000:00010000:2.0:1789596788.652327:0:12484:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789596788.652415:0:12484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3030000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3308:x1876527964826240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 356us (12447us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789596788.652423:0:12484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789596788.652444:0:12484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789596788.652452:0:12484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3308:x1876527964826368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789596788.652468:0:12484:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1789596788.652495:0:12484:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aab1472, atime: 0x6aab1473, ctime: 0x6aab1472, blocks: 0x1 00010000:00010000:2.0:1789596788.652502:0:12484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a41b73/0x8973ae90b38d8891 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.652515:0:12484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=373s v=(0 0) 00010000:00010000:2.0:1789596788.652519:0:12484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596788.652525:0:12484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018a41b73/0x8973ae90b38d8891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.652540:0:12484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018a41b73/0x8973ae90b38d8891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.652549:0:12484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018a41b73/0x8973ae90b38d8891 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.652557:0:12484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018a41b73/0x8973ae90b38d8891 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.652593:0:12484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789596788.653073:0:12484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3308:x1876527964826368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 621us (11708us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789596788.653081:0:12484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:1.0:1789596788.653245:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789596788.653254:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018a41b73/0x8973ae90b38d8891 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.653278:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426000 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:1.0:1789596788.653291:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a41b73/0x8973ae90b38d8891 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.653301:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018a41b73/0x8973ae90b38d8891 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.653321:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018a41b73/0x8973ae90b38d8891 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.653329:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018a41b73/0x8973ae90b38d8891 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.653349:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596788.653351:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596788.653352:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789596788.654141:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ea8c3031500/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789596788.654152:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c3031500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964826368:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1789596788.654167:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ea7c351ed80/2, rc 0, transno 4294967321 00000100:00100000:1.0:1789596788.654171:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea7c351ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964826240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789596788.659755:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596788.661429:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944922112 00000100:00100000:0.0:1789596788.661448:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944922112 00010000:00010000:0.0:1789596788.661491:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ac4025c/0x8973ae90b38d864c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345033 expref: 14 pid: 6692 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596788.661531:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 82 00000100:00100000:0.0:1789596788.661541:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3033800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+14:2354:x1876527944922112:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596788.661556:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596788.661563:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ac4025c/0x8973ae90b38d864c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345033 expref: 14 pid: 6692 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.661577:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ac4025c/0x8973ae90b38d864c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345033 expref: 14 pid: 6692 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.661602:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ac4025c/0x8973ae90b38d864c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345033 expref: 14 pid: 6692 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.661618:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789596788.661623:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789596788.661628:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d0a2c13/0x8973ae90b38d888a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.661656:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d0a2c13/0x8973ae90b38d888a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.661689:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596788.661745:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3033800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+13:2354:x1876527944922112:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 205us (2001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596788.661752:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 82 00010000:00010000:0.0:1789596788.661781:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d0a2c13/0x8973ae90b38d888a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.661790:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d0a2c13/0x8973ae90b38d888a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.661800:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d0a2c13/0x8973ae90b38d888a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.661808:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d0a2c13/0x8973ae90b38d888a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.661847:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789596788.662371:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef647100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3306:x1876527964826112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21525us (22680us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789596788.662381:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:0.0:1789596788.662404:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596788.662410:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d0a2c13/0x8973ae90b38d888a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.662426:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596788.662431:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d0a2c13/0x8973ae90b38d888a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.662440:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d0a2c13/0x8973ae90b38d888a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.662453:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d0a2c13/0x8973ae90b38d888a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.662460:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d0a2c13/0x8973ae90b38d888a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.662478:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596788.662480:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596788.662482:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789596788.662519:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ea7c351e300/2, rc 0, transno 4294967322 00000100:00100000:0.0:1789596788.662526:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea7c351e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964826112:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789596788.735446:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea7c351e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+12:2353:x1876527944921984:12345-192.168.202.44@tcp:16:lhsmtool_posix.0 Request processed in 96712us (97157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596788.735459:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 65 00000001:00080000:2.0:1789596788.735941:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:2.0:1789596788.735954:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1789596788.735970:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000100:00100000:2.0:1789596788.749173:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596788.749358:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944922368 00000100:00100000:3.0:1789596788.749369:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944922368 00000100:00100000:3.0:1789596788.749431:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 227 00000100:00100000:3.0:1789596788.749442:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:11605:x1876527944922368:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789596788.749494:0:10902:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596788.749522:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7400/0x8973ae90b38d8875 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450c6 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.749543:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ea8c36d5800) 00010000:00010000:3.0:1789596788.749549:0:10902:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596788.749577:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8898 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.749591:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.749601:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789596788.749916:0:10902:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e163cac reply state 000000000649b1b5 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596788.749926:0:10902:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789596788.750014:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:11605:x1876527944922368:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 Request processed in 573us (849us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1789596788.750021:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 227 00010000:00010000:0.0:1789596788.753129:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8898 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.753146:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8898 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.753167:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8898 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.753174:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596788.753178:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8898 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.753187:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8898 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.753203:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ea8c36d5800) 00010000:00010000:0.0:1789596788.753206:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596788.753210:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8898 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.753216:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89c00/0x8973ae90b38d8898 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596788.754146:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596788.755539:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944922496 00000100:00100000:1.0:1789596788.755553:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944922496 00000100:00100000:0.0:1789596788.755676:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 69 00000100:00100000:0.0:1789596788.755689:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2353:x1876527944922496:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789596788.755917:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789596788.755922:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789596788 -> 1789596787 00002000:00010000:0.0:1789596788.755925:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789596787 00002000:00010000:0.0:1789596788.755927:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789596788 -> 1789596787 00002000:00010000:0.0:1789596788.755929:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789596788.756002:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2353:x1876527944922496:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 Request processed in 314us (1862us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789596788.756356:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 69 00000100:00100000:3.0:1789596788.766406:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596788.766552:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944922752 00000100:00100000:2.0:1789596788.766563:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944922752 00000100:00100000:2.0:1789596788.766618:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 228 00000100:00100000:2.0:1789596788.766629:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea7c351fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:11605:x1876527944922752:12345-192.168.202.44@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789596788.766698:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d889f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.766717:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8859 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450b8 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.766726:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d889f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.766761:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8859 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450b8 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.766776:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8859 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450b8 expref: 20 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596788.766807:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900246300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1876527964826624:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789596788.767040:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f652ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789596788.769563:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596788.771954:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944922880 00000100:00100000:1.0:1789596788.771969:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944922880 00010000:00010000:1.0:1789596788.772017:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8859 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450b8 expref: 21 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596788.772084:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 83 00000100:00100000:1.0:1789596788.772093:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900246a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:2354:x1876527944922880:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596788.772108:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596788.772116:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8859 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450b8 expref: 21 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.772129:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8859 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450b8 expref: 21 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.772149:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ea8c36d5800) 00010000:00010000:1.0:1789596788.772155:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d889f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.772164:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d889f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.772172:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d889f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.772192:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596788.772257:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900246a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:2354:x1876527944922880:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 164us (2701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596788.772263:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 83 00010000:00010000:3.0:1789596788.781311:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8859 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450b8 expref: 20 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596788.781339:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900246300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5841:1876527964826624:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789596788.781366:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d889f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.781377:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d889f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.781384:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d889f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.781414:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d889f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.781421:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d889f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.781428:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d889f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.781457:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596788.781461:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d889f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.781469:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d889f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.781484:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ea8c36d5800) 00010000:00010000:3.0:1789596788.781487:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789596788.781492:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d889f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.781497:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427e00/0x8973ae90b38d889f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596788.781588:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea7c351fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:11605:x1876527944922752:12345-192.168.202.44@tcp:55:lhsmtool_posix.0 Request processed in 14961us (15191us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789596788.781597:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 228 00000100:00100000:2.0:1789596788.788530:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596788.788625:0:12484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944923008 00000100:00100000:3.0:1789596788.788638:0:12484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944923008 00000100:00100000:3.0:1789596788.788706:0:12484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 70 00000100:00100000:3.0:1789596788.788716:0:12484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2351:x1876527944923008:12345-192.168.202.44@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789596788.788762:0:12484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d88a6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.788783:0:12484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000097f0f852/0x8973ae90b38d8883 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450d4 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.788812:0:12484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596788.788848:0:12484:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789596788.788853:0:12484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d88a6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.788891:0:12484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000097f0f852/0x8973ae90b38d8883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450d4 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.788906:0:12484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000097f0f852/0x8973ae90b38d8883 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450d4 expref: 8 pid: 6693 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596788.788920:0:12484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea7c351f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12484:1876527964826752:192.168.202.44@tcp:104: 00000100:00100000:3.0:1789596788.788994:0:12484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6a03600 going to sleep for 11 seconds 00000100:00100000:2.0:1789596788.793092:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596788.793192:0:12484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea7c351f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12484:1876527964826752:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789596788.793220:0:12484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d88a6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596788.793339:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944923136 00000100:00100000:0.0:1789596788.793348:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944923136 00010000:00010000:0.0:1789596788.793382:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000097f0f852/0x8973ae90b38d8883 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450d4 expref: 9 pid: 6693 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596788.793420:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 84 00000100:00100000:0.0:1789596788.793429:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f64eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+9:2354:x1876527944923136:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596788.793444:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596788.793470:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000097f0f852/0x8973ae90b38d8883 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450d4 expref: 9 pid: 6693 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.793484:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000097f0f852/0x8973ae90b38d8883 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450d4 expref: 9 pid: 6693 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.793506:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097f0f852/0x8973ae90b38d8883 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450d4 expref: 9 pid: 6693 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.793523:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789596788.793528:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789596788.793533:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d88a6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.793544:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d88a6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.793573:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596788.793602:0:12484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d88a6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.793614:0:12484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d88a6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596788.793627:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f64eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2354:x1876527944923136:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 197us (548us total) trans 0 rc 0/0 00010000:00010000:3.0:1789596788.793641:0:12484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d88a6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596788.793647:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 84 00010000:00010000:3.0:1789596788.794436:0:12484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d88a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.794446:0:12484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d88a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.794454:0:12484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88400 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:3.0:1789596788.794459:0:12484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d88a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.794469:0:12484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d88a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.794484:0:12484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d88a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.794492:0:12484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068ddbcdb/0x8973ae90b38d88a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596788.794952:0:12484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900246300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2351:x1876527944923008:12345-192.168.202.44@tcp:1:lhsmtool_posix.0 Request processed in 6232us (6425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596788.794962:0:12484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 70 00000100:00100000:2.0:1789596788.797938:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596788.798024:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944923392 00000100:00100000:3.0:1789596788.798034:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944923392 00000100:00100000:3.0:1789596788.798095:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 229 00000100:00100000:3.0:1789596788.798108:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:11605:x1876527944923392:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789596788.798185:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.798217:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.798229:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.798446:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.798458:0:10902:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8867 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450bf expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.798467:0:10902:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88b4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.798501:0:10902:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8867 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450bf expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.798516:0:10902:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8867 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450bf expref: 20 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596788.798530:0:10902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea7c351f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10902:1876527964826880:192.168.202.44@tcp:104: 00000100:00100000:3.0:1789596788.798624:0:10902:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6a03600 going to sleep for 11 seconds 00000100:00100000:0.0:1789596788.801378:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596788.801466:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944923520 00000100:00100000:1.0:1789596788.801475:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944923520 00000100:00100000:3.0:1789596788.801481:0:10902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea7c351f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10902:1876527964826880:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789596788.801510:0:10902:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.801514:0:7644:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8867 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450bf expref: 21 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596788.801562:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 85 00000100:00100000:1.0:1789596788.801572:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:2354:x1876527944923520:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596788.801587:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596788.801594:0:7644:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8867 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450bf expref: 21 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.801606:0:7644:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8867 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450bf expref: 21 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.801626:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8867 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450bf expref: 21 pid: 5842 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.801643:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ea8c36d5800) 00010000:00010000:1.0:1789596788.801648:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.801659:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.801667:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88b4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.801696:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789596788.801724:0:10902:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.801748:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596788.801760:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef766a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:2354:x1876527944923520:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 188us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596788.801777:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 85 00000001:00080000:3.0:1789596788.801963:0:10902:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1789596788.802110:0:10902:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1789596788.802203:0:10902:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1789596788.802288:0:10902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea7c351f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10902:1876527964827008:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789596788.802337:0:10902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596788.802372:0:10902:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6a03b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596788.802436:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964827008 00000100:00100000:0.0:1789596788.802441:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964827008 00000100:00100000:0.0:1789596788.802483:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789596788.802491:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea7c351c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:10902:x1876527964827008:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789596788.802572:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea7c351c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:10902:x1876527964827008:12345-0@lo:1000:mdt00_003.0 Request processed in 81us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596788.802579:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789596788.802641:0:10902:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:3.0:1789596788.802647:0:10902:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:3.0:1789596788.802670:0:10902:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9ea7c351ed80 x1876527964826240/t4294967321(4294967321) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789596804 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596788.802681:0:10902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea7c351f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10902:1876527964827008:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789596788.803116:0:10902:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1789596788.803167:0:10902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea7c351f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10902:1876527964827136:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789596788.803195:0:10902:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596788.803208:0:10902:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6912600 going to sleep for 11 seconds 00000100:00100000:0.0:1789596788.803265:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964827136 00000100:00100000:0.0:1789596788.803270:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964827136 00000100:00100000:0.0:1789596788.803301:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789596788.803308:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea7c351ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:10902:x1876527964827136:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789596788.803465:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea7c351ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:10902:x1876527964827136:12345-0@lo:1000:mdt00_003.0 Request processed in 157us (270us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789596788.803472:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789596788.803540:0:10902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea7c351f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10902:1876527964827136:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789596788.803564:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.803573:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88b4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.803581:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.803599:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596788.803603:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.803611:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88b4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.803624:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ea8c36d5800) 00010000:00010000:3.0:1789596788.803627:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789596788.803632:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88b4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.803639:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88b4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.803667:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d87f7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.803675:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d87f7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.803682:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d87f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.803687:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596788.803690:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d87f7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.803696:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d87f7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.803717:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:3.0:1789596788.803720:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789596788.803726:0:10902:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7a00/0x8973ae90b38d87fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450a3 expref: 23 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.803737:0:10902:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7a00/0x8973ae90b38d87fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450a3 expref: 23 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.803746:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7a00/0x8973ae90b38d87fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450a3 expref: 23 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.803783:0:10902:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7a00/0x8973ae90b38d87fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450a3 expref: 23 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596788.803794:0:10902:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa444000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10902:1876527964827264:192.168.202.44@tcp:105: 00000100:00100000:3.0:1789596788.803879:0:10902:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6912600 going to sleep for 11 seconds 00000100:00100000:0.0:1789596788.808219:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596788.808328:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944923648 00000100:00100000:2.0:1789596788.808339:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944923648 00000100:00100000:3.0:1789596788.808341:0:10902:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa444000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10902:1876527964827264:192.168.202.44@tcp:105: 00010000:00010000:3.0:1789596788.808370:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d87f7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.808382:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426800/0x8973ae90b38d87f7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596788.808406:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 61 00010000:00010000:3.0:1789596788.808414:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d88bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596788.808421:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+24:11604:x1876527944923648:12345-192.168.202.44@tcp:49:lfs.0 00010000:00010000:3.0:1789596788.808432:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d88bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.808461:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d88bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.808471:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d88bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.808477:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d88bb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.808485:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d88bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.808491:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596788.808496:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d88bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.808504:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d88bb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.808517:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:3.0:1789596788.808520:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596788.808524:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d88bb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.808530:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d88bb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.808541:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.808548:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.808561:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596788.808566:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+24:11604:x1876527944923648:12345-192.168.202.44@tcp:49:lfs.0 Request processed in 147us (355us total) trans 0 rc 0/0 00010000:00010000:3.0:1789596788.808572:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596788.808578:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596788.808580:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 61 00010000:00010000:3.0:1789596788.808591:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.808602:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:3.0:1789596788.808604:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789596788.808608:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.808614:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596788.808856:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:11605:x1876527944923392:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 Request processed in 10751us (10927us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1789596788.808866:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 229 00000020:00080000:3.0:1789596788.808871:0:10902:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789596788.809057:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789596788.809062:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789596788.809585:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:0.0:1789596788.809594:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789596788.820742:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596788.820862:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944923904 00000100:00100000:3.0:1789596788.820874:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944923904 00000100:00100000:3.0:1789596788.820938:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 230 00000100:00100000:3.0:1789596788.820949:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:11604:x1876527944923904:12345-192.168.202.44@tcp:58:lfs.0 00000040:00080000:3.0:1789596788.821344:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789596788.821422:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:11604:x1876527944923904:12345-192.168.202.44@tcp:58:lfs.0 Request processed in 473us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596788.821440:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 230 00000100:00100000:2.0:1789596788.822812:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596788.822973:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944924160 00000100:00100000:3.0:1789596788.822981:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944924160 00000100:00100000:3.0:1789596788.823043:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 62 00000100:00100000:3.0:1789596788.823052:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3553850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+23:11605:x1876527944924160:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789596788.823693:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789596788.823797:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1789596788.823877:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.823897:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.823908:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.823916:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88c2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.823922:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88c2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.823929:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596788.823954:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789596788.824049:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3553850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+25:11605:x1876527944924160:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 Request processed in 996us (1241us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1789596788.824056:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 62 00000020:00080000:3.0:1789596788.824068:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789596788.824581:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596788.824589:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.824597:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89600 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596788.824601:0:7643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.824608:0:7643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.824621:0:7643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ea8d1438900) 00010000:00010000:2.0:1789596788.824633:0:7643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789596788.824638:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88c2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.824644:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f89600/0x8973ae90b38d88c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.824662:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596788.824664:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596788.824665:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596788.854725:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596788.854891:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944924288 00000100:00100000:1.0:1789596788.854903:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944924288 00000100:00100000:1.0:1789596788.854965:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 231 00000100:00100000:1.0:1789596788.854975:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+25:11607:x1876527944924288:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:1.0:1789596788.854999:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596788.855031:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d88c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3450db expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.855092:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d88d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.855106:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d88d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.855117:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d88d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.855131:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d88d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.855139:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d88d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.855146:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d88d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.855398:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d88de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.855420:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d87e9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34509c expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.855429:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d88de lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.855466:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d87e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34509c expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596788.855481:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d87e9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34509c expref: 26 pid: 5843 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596788.855496:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa659180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964827392:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789596788.855586:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f6948180 going to sleep for 11 seconds 00000100:00100000:0.0:1789596788.861497:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596788.861869:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944924544 00000100:00100000:3.0:1789596788.861881:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944924544 00000100:00100000:3.0:1789596788.861951:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 63 00000100:00100000:3.0:1789596788.861962:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:5590:x1876527944924544:12345-192.168.202.44@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789596788.862203:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+28:5590:x1876527944924544:12345-192.168.202.44@tcp:35:ldlm_bl.0 Request processed in 242us (715us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1789596788.862211:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 63 00000100:00100000:1.0:1789596788.862998:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa659180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5843:1876527964827392:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596788.863033:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d88de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596788.864563:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596788.864761:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944924672 00000100:00100000:0.0:1789596788.864772:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944924672 00010000:00010000:0.0:1789596788.864808:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d87e9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34509c expref: 28 pid: 5843 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596788.864888:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 86 00000100:00100000:0.0:1789596788.864897:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6572d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+28:2353:x1876527944924672:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596788.864911:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596788.864918:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d87e9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34509c expref: 28 pid: 5843 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.864930:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d87e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34509c expref: 28 pid: 5843 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.864949:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33e00/0x8973ae90b38d87e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34509c expref: 28 pid: 5843 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.864964:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:0.0:1789596788.864969:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d88de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.864977:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d88de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.864985:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d88de lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596788.865029:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596788.865081:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6572d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+27:2353:x1876527944924672:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 184us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596788.865088:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 86 00010000:00010000:2.0:1789596788.865557:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d88de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.865566:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d88de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596788.865619:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789596788.865625:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789596788.865646:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d88de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.865660:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d88de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.865669:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d88d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.865675:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d88d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.865682:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d88d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.865700:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596788.865704:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d88d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.865712:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d88d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.865722:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:2.0:1789596788.865724:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596788.865728:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d88d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.865734:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32200/0x8973ae90b38d88d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.865746:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d88d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.865752:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d88d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.865758:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d88d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.865762:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596788.865765:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d88d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.865770:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d88d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.865787:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ea8c36d5f00) 00010000:00010000:2.0:1789596788.865790:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596788.865793:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d88d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.865798:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32c00/0x8973ae90b38d88d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.865876:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33400/0x8973ae90b38d88c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450db expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.865892:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d88de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450db expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596788.865898:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:2.0:1789596788.865900:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596788.865903:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a33600, rc 0) 00000100:00100000:2.0:1789596788.865948:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:11607:x1876527944924288:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 10974us (11234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596788.865956:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 231 00010000:00010000:1.0:1789596789.671584:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789596789.814609:0:12523:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789596789.814620:0:12523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789596789.814672:0:12523:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:1.0:1789596789.814678:0:12523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789596789.852296:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789596789.852315:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789596789.852512:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789596789.852520:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789596789.853076:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f7495180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876527964827520:192.168.202.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789596789.853790:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ef49d540 going to sleep for 11 seconds 00000100:00100000:0.0:1789596789.862772:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596789.862940:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f7495180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11696:1876527964827520:192.168.202.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789596789.864215:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944924800 00000100:00100000:3.0:1789596789.864227:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944924800 00000100:00100000:3.0:1789596789.864603:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 232 00000100:00100000:3.0:1789596789.864618:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:11618:x1876527944924800:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789596789.864660:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789596789.864799:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:11618:x1876527944924800:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 Request processed in 185us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596789.875244:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 232 00000100:00100000:2.0:1789596789.876108:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596789.879422:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944925056 00000100:00100000:3.0:1789596789.879438:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944925056 00000100:00100000:3.0:1789596789.879514:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 233 00000100:00100000:3.0:1789596789.879525:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+26:11618:x1876527944925056:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596789.879546:0:10902:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596789.879568:0:10902:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d88e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3450e2 expref: -99 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596789.879758:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596789.879792:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596789.879805:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596789.879842:0:10902:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789596789.881101:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88400/0x8973ae90b38d88e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450e2 expref: 29 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596789.881130:0:10902:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450e2 expref: 28 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596789.881140:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:3.0:1789596789.881143:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789596789.881147:0:10902:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88600, rc 0) 00000100:00100000:3.0:1789596789.881230:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+28:11618:x1876527944925056:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 1706us (5124us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789596789.881240:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 233 00000100:00100000:2.0:1789596789.887753:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596789.887795:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596789.887910:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944925312 00000100:00100000:0.0:1789596789.887920:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944925312 00000100:00100000:0.0:1789596789.887980:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 234 00000100:00100000:0.0:1789596789.887991:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+28:11618:x1876527944925312:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789596789.888080:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d88fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596789.888097:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d88fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596789.888108:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d88fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596789.888307:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d88fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596789.888315:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d88fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596789.888323:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d88fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596789.888341:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596789.888346:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d88fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596789.888366:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d88fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596789.888377:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:0.0:1789596789.888381:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789596789.888386:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d88fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596789.888392:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d88fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596789.888529:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+29:11618:x1876527944925312:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 Request processed in 539us (785us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1789596789.888537:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 234 00000100:00100000:3.0:1789596789.889015:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944925440 00000100:00100000:3.0:1789596789.889022:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944925440 00000100:00100000:3.0:1789596789.889064:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 16 00000100:00100000:3.0:1789596789.889071:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6572300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+29:2351:x1876527944925440:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596789.889081:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596789.889096:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d88ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450e2 expref: 29 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596789.889121:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:3.0:1789596789.889125:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596789.889146:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6572300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+28:2351:x1876527944925440:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 76us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596789.889153:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 16 00000040:00080000:2.0:1789596789.889632:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789596789.889638:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789596789.890733:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789596789.890766:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789596789.893937:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596789.895529:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944925696 00000100:00100000:2.0:1789596789.895545:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944925696 00000100:00100000:2.0:1789596789.895633:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 64 00000100:00100000:2.0:1789596789.895645:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+28:11618:x1876527944925696:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789596789.896100:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+29:11618:x1876527944925696:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 Request processed in 457us (2171us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789596789.896109:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 64 00000100:00100000:2.0:1789596790.122386:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596790.122473:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596790.122505:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596790.122552:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596790.122597:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944926208 00000100:00100000:2.0:1789596790.122608:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944926208 00000100:00100000:2.0:1789596790.122674:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 152 00000100:00100000:2.0:1789596790.122686:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2352:x1876527944926208:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596790.122759:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2352:x1876527944926208:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 76us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596790.122766:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 152 00000100:00080000:2.0:1789596790.122784:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789596790.125127:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944926080 00000100:00100000:1.0:1789596790.125142:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944926080 00000100:00100000:1.0:1789596790.125217:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944925952 00000100:00100000:1.0:1789596790.125221:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944925952 00000100:00100000:1.0:1789596790.125252:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 72 00000100:00100000:1.0:1789596790.125287:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2352:x1876527944926080:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596790.125360:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6572a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2352:x1876527944926080:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 76us (2886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596790.125367:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 72 00000100:00100000:1.0:1789596790.125385:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 73 00000100:00100000:1.0:1789596790.125391:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2352:x1876527944925952:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596790.125416:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2352:x1876527944925952:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 25us (2910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596790.125421:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 73 00000100:00080000:2.0:1789596790.128509:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789596790.128521:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789596790.129990:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944925824 00000100:00100000:3.0:1789596790.130418:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944925824 00000100:00100000:1.0:1789596790.131183:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 294 00000100:00100000:1.0:1789596790.131197:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2352:x1876527944925824:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596790.131570:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2352:x1876527944925824:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 373us (9192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596790.131589:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 294 00000001:00080000:3.0:1789596790.338429:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1789596790.338449:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1789596790.338454:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:0.0:1789596790.683139:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596791.714231:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596791.836421:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789596791.836444:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964827648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596791.836518:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596791.836590:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964827648 00000100:00100000:2.0:1789596791.836604:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964827648 00000100:00100000:2.0:1789596791.836663:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789596791.836673:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea9004cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3307:x1876527964827648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596791.836713:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789596791.836759:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea9004cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3307:x1876527964827648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596791.836766:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1789596791.836998:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596791.837033:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964827648:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1789596792.108332:0:12575:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789596792.108342:0:12575:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789596792.108393:0:12575:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789596792.108401:0:12575:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789596792.347050:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964828160:0@lo:400:kworker.0 00000100:00100000:1.0:1789596792.347114:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596792.347166:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789596792.347172:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964827776:0@lo:400:kworker.0 00000100:00100000:1.0:1789596792.347199:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596792.347219:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964828288:0@lo:400:kworker.0 00000100:00100000:1.0:1789596792.347240:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596792.347278:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964827904:0@lo:400:kworker.0 00000100:00100000:1.0:1789596792.347299:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596792.347322:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964828416:0@lo:400:kworker.0 00000100:00100000:1.0:1789596792.347340:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596792.347372:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789596792.347378:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964828032:0@lo:400:kworker.0 00000100:00100000:1.0:1789596792.347399:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596792.347425:0:12484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964828160 00000100:00100000:1.0:1789596792.347432:0:12484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964828160 00000100:00100000:1.0:1789596792.347475:0:12484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964828416 00000100:00100000:1.0:1789596792.347478:0:12484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964828416 00000100:00100000:1.0:1789596792.347509:0:12484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789596792.347518:0:12484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3306:x1876527964828160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596792.347568:0:12484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3306:x1876527964828160:12345-0@lo:400:kworker.0 Request processed in 51us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596792.347575:0:12484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789596792.347592:0:12484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789596792.347598:0:12484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa65ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964828416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596792.347629:0:12484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa65ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964828416:12345-0@lo:400:kworker.0 Request processed in 32us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596792.347635:0:12484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789596792.347653:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964827776 00000100:00100000:1.0:1789596792.347656:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964827776 00000100:00100000:1.0:1789596792.347681:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789596792.347686:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964827776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596792.347714:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964827776:12345-0@lo:400:kworker.0 Request processed in 27us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596792.347720:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789596792.347745:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964828288 00000100:00100000:1.0:1789596792.347754:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964828288 00000100:00100000:1.0:1789596792.347780:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964827904 00000100:00100000:1.0:1789596792.347782:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964827904 00000100:00100000:1.0:1789596792.347793:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964828032 00000100:00100000:1.0:1789596792.347795:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964828032 00000100:00100000:1.0:1789596792.347810:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789596792.347852:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964828288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596792.347884:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964828288:12345-0@lo:400:kworker.0 Request processed in 69us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596792.347890:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789596792.347902:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789596792.347909:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964827904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596792.347934:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964827904:12345-0@lo:400:kworker.0 Request processed in 26us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596792.347940:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789596792.347951:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789596792.347957:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964828032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596792.347981:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964828032:12345-0@lo:400:kworker.0 Request processed in 25us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596792.347986:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789596792.348035:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964828032:0@lo:400:kworker.0 00000100:00100000:1.0:1789596792.348047:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964827904:0@lo:400:kworker.0 00000100:00100000:1.0:1789596792.348057:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789596792.348063:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1789596792.348081:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ea8c3031500, transno 4294967310 00000100:00100000:1.0:1789596792.348095:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964828416:0@lo:400:kworker.0 00000100:00100000:1.0:1789596792.348134:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964827776:0@lo:400:kworker.0 00000100:00100000:1.0:1789596792.348145:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964828288:0@lo:400:kworker.0 00000100:00100000:1.0:1789596792.348156:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964828160:0@lo:400:kworker.0 00000100:00080000:2.0:1789596792.349178:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789596792.349187:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596792.431239:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596792.431570:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944926464 00000100:00100000:1.0:1789596792.431581:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944926464 00000100:00100000:1.0:1789596792.431786:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 235 00000100:00100000:1.0:1789596792.431803:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+29:11640:x1876527944926464:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:1.0:1789596792.431848:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596792.431870:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8901 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3450e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596792.431971:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8908 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596792.431987:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8908 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596792.432001:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8908 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596792.432018:0:5841:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789596792.432151:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8901 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450e9 expref: 32 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596792.432171:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8908 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450e9 expref: 31 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596792.432201:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:1.0:1789596792.432204:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789596792.432208:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a33200, rc 0) 00000100:00100000:1.0:1789596792.432343:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+31:11640:x1876527944926464:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 541us (1116us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789596792.432350:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 235 00000100:00080000:2.0:1789596792.432541:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596792.442356:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596792.442437:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944926592 00000100:00100000:3.0:1789596792.442449:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944926592 00000100:00100000:3.0:1789596792.442513:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 236 00000100:00100000:3.0:1789596792.442524:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+31:11640:x1876527944926592:12345-192.168.202.44@tcp:54:lfs.0 00010000:00010000:3.0:1789596792.442602:0:10902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8916 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596792.442623:0:10902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596792.442636:0:10902:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596792.442675:0:10902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596792.442683:0:10902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8916 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596792.442690:0:10902:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8916 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596792.442696:0:10902:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596792.442700:0:10902:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8916 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596792.442707:0:10902:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8916 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596792.442722:0:10902:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:3.0:1789596792.442726:0:10902:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789596792.442733:0:10902:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8916 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596792.442739:0:10902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88600/0x8973ae90b38d8916 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10902 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596792.442958:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+31:11640:x1876527944926592:12345-192.168.202.44@tcp:54:lfs.0 Request processed in 435us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596792.442966:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 236 00000100:00100000:0.0:1789596792.587330:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596792.587582:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944926720 00000100:00100000:2.0:1789596792.587594:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944926720 00000100:00080000:0.0:1789596792.587670:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596792.587685:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 71 00000100:00100000:2.0:1789596792.587698:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f7495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2353:x1876527944926720:12345-192.168.202.44@tcp:101:cat.0 00010000:00010000:2.0:1789596792.587716:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596792.587738:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b56b9f9/0x8973ae90b38d891d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3450f0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789596792.587767:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aab1473, atime: 0x6aab1473, ctime: 0x6aab1473, blocks: 0xb 00010000:00010000:2.0:1789596792.587789:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1789596792.587794:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596792.587803:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b56b9f9/0x8973ae90b38d891d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450f0 expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596792.587878:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b56b9f9/0x8973ae90b38d891d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450f0 expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596792.587892:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427a00, rc 0) 00000100:00100000:2.0:1789596792.587954:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f7495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2353:x1876527944926720:12345-192.168.202.44@tcp:101:cat.0 Request processed in 260us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596792.587960:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 71 00000100:00100000:3.0:1789596792.591771:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596792.591868:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944926848 00000100:00100000:2.0:1789596792.591880:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944926848 00002000:00100000:2.0:1789596792.591930:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9ea8fa447800 x1876527944926848/t0(0) o3->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:673/0 lens 488/0 e 0 to 0 dl 1789596803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789596792.591941:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8fa447800 with x1876527944926848 ext(0->4095) 00002000:00010000:2.0:1789596792.591947:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ea8fa447800 00000100:00100000:2.0:1789596792.591991:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 7 00000100:00100000:2.0:1789596792.592002:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2354:x1876527944926848:12345-192.168.202.44@tcp:3:cat.0 00000100:00100000:2.0:1789596792.592564:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+8:2354:x1876527944926848:12345-192.168.202.44@tcp:3:cat.0 Request processed in 562us (800us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789596792.592574:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 7 00002000:00100000:2.0:1789596792.592582:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9ea8fa447800 x1876527944926848/t0(0) o3->1fdd0e7b-fe25-4537-b350-ae6aecfab059@192.168.202.44@tcp:673/0 lens 488/4536 e 0 to 0 dl 1789596803 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789596792.592603:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ea8fa447800 with x1876527944926848 ext(0->4095) 00002000:00010000:2.0:1789596792.592607:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ea8fa447800 00010000:00010000:1.0:1789596792.731511:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596792.861857:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596792.861882:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964828544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596792.861960:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596792.862256:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964828544 00000100:00100000:3.0:1789596792.862265:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964828544 00000100:00100000:3.0:1789596792.862336:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789596792.862345:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964828544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789596792.862379:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596792.862445:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900466680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964828544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596792.862452:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789596792.862586:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964828544:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789596793.762039:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789596793.956401:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1789596793.956417:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1789596793.982799:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:2.0:1789596793.982856:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:2.0:1789596793.982869:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1789596793.982896:0:5863:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ea8f69120c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1789596793.982902:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ea8c63b9600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ea8f6912c00 00000020:00080000:2.0:1789596793.982906:0:5863:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ea8c63b9e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ea8d5aa4800 00000020:00080000:2.0:1789596793.982927:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1789596793.983896:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1789596794.780313:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596795.252172:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596795.252208:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596795.252251:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596795.252270:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596795.252295:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596795.252303:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944927232 00000100:00100000:3.0:1789596795.252313:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944927232 00000100:00100000:2.0:1789596795.252314:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944927488 00000100:00100000:2.0:1789596795.252318:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944927488 00000100:00100000:2.0:1789596795.252371:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944927104 00000100:00100000:1.0:1789596795.252372:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944926976 00000100:00100000:2.0:1789596795.252374:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944927104 00000100:00100000:1.0:1789596795.252375:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944926976 00000100:00100000:3.0:1789596795.252518:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944927360 00000100:00100000:3.0:1789596795.252522:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944927360 00000100:00100000:3.0:1789596795.252549:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 76 00000100:00100000:3.0:1789596795.252559:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2353:x1876527944927232:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596795.253956:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2353:x1876527944927232:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 1389us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596795.253969:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 76 00000100:00100000:3.0:1789596795.254121:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 77 00000100:00100000:3.0:1789596795.254132:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2353:x1876527944927360:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596795.254165:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2353:x1876527944927360:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 37us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596795.254171:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 77 00000100:00100000:1.0:1789596795.254303:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 296 00000100:00100000:1.0:1789596795.254314:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2353:x1876527944926976:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596795.254344:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2353:x1876527944926976:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 32us (2183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596795.254351:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 296 00000100:00100000:3.0:1789596795.254849:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 156 00000100:00100000:3.0:1789596795.254863:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2353:x1876527944927488:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596795.254913:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2353:x1876527944927488:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 54us (2661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596795.254938:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 156 00000100:00080000:0.0:1789596795.256842:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789596795.256852:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789596795.256856:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596795.258845:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 157 00000100:00100000:2.0:1789596795.258861:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:2353:x1876527944927104:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596795.258968:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:2353:x1876527944927104:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 111us (6696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596795.258977:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 157 00010000:00010000:1.0:1789596795.804594:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596796.829748:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596796.966139:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789596796.970369:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea900466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964828672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596796.970438:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596796.970610:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964828672 00000100:00100000:2.0:1789596796.970620:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964828672 00000100:00100000:2.0:1789596796.970689:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789596796.970699:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964828672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596796.970746:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789596796.970839:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900464700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964828672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596796.970853:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789596796.970893:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1789596796.970900:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ea7c351ed80, transno 4294967321 00000004:00080000:2.0:1789596796.970910:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ea7c351e300, transno 4294967322 00000004:00080000:2.0:1789596796.970915:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1789596796.970938:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea900466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964828672:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789596796.971039:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596797.486013:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964828800:0@lo:400:kworker.0 00000100:00100000:0.0:1789596797.486078:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596797.486169:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876527964829312:0@lo:400:kworker.0 00000100:00100000:0.0:1789596797.486212:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596797.486242:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789596797.486249:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964829184:0@lo:400:kworker.0 00000100:00100000:0.0:1789596797.486275:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596797.486443:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964828928:0@lo:400:kworker.0 00000100:00100000:0.0:1789596797.486471:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596797.486488:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964829440:0@lo:400:kworker.0 00000100:00100000:0.0:1789596797.486507:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596797.486523:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596797.486527:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964829056:0@lo:400:kworker.0 00000100:00100000:0.0:1789596797.486544:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596797.486567:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964829312 00000100:00100000:0.0:1789596797.486574:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964829312 00000100:00100000:0.0:1789596797.486632:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964828928 00000100:00100000:0.0:1789596797.486635:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964828928 00000100:00100000:0.0:1789596797.486645:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964829056 00000100:00100000:0.0:1789596797.486647:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964829056 00000100:00100000:0.0:1789596797.486661:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789596797.486668:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876527964829312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596797.486714:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900465500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876527964829312:12345-0@lo:400:kworker.0 Request processed in 46us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596797.486721:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789596797.486735:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789596797.486750:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964828928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596797.486776:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964828928:12345-0@lo:400:kworker.0 Request processed in 27us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596797.486783:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789596797.486793:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789596797.486799:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964829056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596797.486843:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964829056:12345-0@lo:400:kworker.0 Request processed in 45us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596797.486849:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789596797.486865:0:12484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964829184 00000100:00100000:0.0:1789596797.486868:0:12484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964829184 00000100:00100000:0.0:1789596797.486887:0:12484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964829440 00000100:00100000:0.0:1789596797.486890:0:12484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964829440 00000100:00100000:0.0:1789596797.486906:0:12484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789596797.486911:0:12484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964829184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596797.486937:0:12484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900466a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964829184:12345-0@lo:400:kworker.0 Request processed in 26us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596797.486942:0:12484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789596797.486951:0:12484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789596797.486956:0:12484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964829440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596797.486975:0:12484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964829440:12345-0@lo:400:kworker.0 Request processed in 20us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596797.486981:0:12484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1789596797.486995:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789596797.487000:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596797.487023:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964829184:0@lo:400:kworker.0 00000100:00100000:0.0:1789596797.487042:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876527964829312:0@lo:400:kworker.0 00000100:00100000:0.0:1789596797.487067:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964829056:0@lo:400:kworker.0 00000100:00100000:0.0:1789596797.487075:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964828928:0@lo:400:kworker.0 00000100:00100000:0.0:1789596797.487082:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964829440:0@lo:400:kworker.0 00000100:00100000:1.0:1789596797.493669:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964828800 00000100:00100000:1.0:1789596797.493687:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964828800 00000100:00100000:1.0:1789596797.493758:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789596797.493770:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c51de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3307:x1876527964828800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596797.493877:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c51de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3307:x1876527964828800:12345-0@lo:400:kworker.0 Request processed in 110us (7797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596797.493885:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1789596797.497184:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964828800:0@lo:400:kworker.0 00000100:00100000:1.0:1789596797.760467:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596797.760606:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944927616 00000100:00100000:0.0:1789596797.760617:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944927616 00000100:00100000:0.0:1789596797.760699:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 237 00000100:00100000:0.0:1789596797.760708:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa65a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:11293:x1876527944927616:12345-192.168.202.44@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789596797.761046:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa65a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:11293:x1876527944927616:12345-192.168.202.44@tcp:60:lhsmtool_posix.0 Request processed in 337us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596797.761056:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 237 00000100:00080000:2.0:1789596797.761125:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596797.763790:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596797.764079:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944927872 00000100:00100000:3.0:1789596797.764088:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944927872 00000100:00100000:3.0:1789596797.764146:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 65 00000100:00100000:3.0:1789596797.764162:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:11293:x1876527944927872:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789596797.764472:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:11293:x1876527944927872:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 Request processed in 316us (689us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1789596797.764480:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 65 00010000:00010000:3.0:1789596797.852643:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596797.980314:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596797.980340:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa444a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964829568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596797.980406:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596797.980593:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964829568 00000100:00100000:1.0:1789596797.980614:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964829568 00000100:00100000:1.0:1789596797.980664:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789596797.980672:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964829568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789596797.980706:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789596797.980755:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964829568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596797.980762:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789596797.981321:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa444a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964829568:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789596798.884395:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789596799.112033:0:5863:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:1.0:1789596799.112078:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1789596799.112105:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1789596799.112129:0:5874:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1789596799.141429:0:11696:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789596799.141665:0:11696:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789596799.142677:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1789596799.142893:0:11696:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789596799.903853:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789596800.051993:0:12777:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 18:13:18 (1789596798) 00000100:00100000:0.0:1789596800.362522:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596800.362568:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596800.362603:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596800.362628:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596800.362652:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596800.362686:0:12484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944928256 00000100:00100000:0.0:1789596800.362696:0:12484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944928256 00000100:00100000:0.0:1789596800.362765:0:12484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944928384 00000100:00100000:0.0:1789596800.362769:0:12484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944928384 00000100:00100000:0.0:1789596800.362806:0:12484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 80 00000100:00100000:0.0:1789596800.362841:0:12484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2354:x1876527944928256:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596800.362933:0:12484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2354:x1876527944928256:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 118us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596800.362941:0:12484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 80 00000100:00100000:0.0:1789596800.362961:0:12484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 81 00000100:00100000:0.0:1789596800.362968:0:12484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2354:x1876527944928384:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596800.362991:0:12484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2354:x1876527944928384:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 24us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596800.362997:0:12484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 81 00000100:00100000:2.0:1789596800.363279:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944928000 00000100:00100000:2.0:1789596800.363284:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944928000 00000100:00100000:2.0:1789596800.363325:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 298 00000100:00100000:2.0:1789596800.363333:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2354:x1876527944928000:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596800.363361:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2354:x1876527944928000:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 29us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596800.363367:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 298 00000100:00100000:2.0:1789596800.363397:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944928512 00000100:00100000:2.0:1789596800.363401:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944928512 00000100:00100000:2.0:1789596800.363433:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944928128 00000100:00100000:2.0:1789596800.363436:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944928128 00000100:00100000:2.0:1789596800.363459:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 161 00000100:00100000:2.0:1789596800.363466:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c310ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2354:x1876527944928512:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596800.363505:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c310ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2354:x1876527944928512:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 40us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596800.363512:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 161 00000100:00100000:2.0:1789596800.363525:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 162 00000100:00100000:2.0:1789596800.363533:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c31e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:2354:x1876527944928128:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596800.363563:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c31e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:2354:x1876527944928128:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 31us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596800.363569:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 162 00000100:00080000:2.0:1789596800.363589:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789596800.363594:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789596800.363596:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789596800.923083:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596801.951724:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596802.075032:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789596802.075055:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964829696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596802.075126:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596802.075203:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964829696 00000100:00100000:0.0:1789596802.075210:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964829696 00000100:00100000:0.0:1789596802.075271:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789596802.075280:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964829696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789596802.075313:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596802.075371:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964829696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596802.075379:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1789596802.075403:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789596802.075439:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964829696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596802.565774:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596802.565905:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944928640 00000100:00100000:2.0:1789596802.565917:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944928640 00000100:00080000:0.0:1789596802.565977:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596802.566002:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 238 00000100:00100000:2.0:1789596802.566013:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:12304:x1876527944928640:12345-192.168.202.44@tcp:101:lsof.0 00010000:00010000:2.0:1789596802.566036:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596802.566054:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d8924 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3450f7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596802.566120:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d892b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596802.566134:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d892b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596802.566150:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d892b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596802.566208:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789596802.566211:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789596802.566246:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d892b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596802.566269:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d8924 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450f7 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596802.566285:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d892b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450f7 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596802.566291:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8d1438400) 00010000:00010000:2.0:1789596802.566293:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789596802.566296:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426600, rc 0) 00000100:00100000:2.0:1789596802.566462:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+6:12304:x1876527944928640:12345-192.168.202.44@tcp:101:lsof.0 Request processed in 450us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596802.566470:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 238 00000100:00100000:0.0:1789596802.587302:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964829824:0@lo:400:kworker.0 00000100:00100000:0.0:1789596802.587386:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596802.587444:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964830336:0@lo:400:kworker.0 00000100:00100000:0.0:1789596802.587473:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596802.587502:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789596802.587508:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876527964830208:0@lo:400:kworker.0 00000100:00100000:0.0:1789596802.587534:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596802.587570:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964830336 00000100:00100000:0.0:1789596802.587580:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964830336 00000100:00100000:3.0:1789596802.587757:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964829952:0@lo:400:kworker.0 00000100:00100000:3.0:1789596802.587790:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596802.587848:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964829824 00000100:00100000:3.0:1789596802.587853:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964829824 00000100:00100000:3.0:1789596802.587906:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1789596802.587915:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3307:x1876527964829824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596802.587966:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3307:x1876527964829824:12345-0@lo:400:kworker.0 Request processed in 51us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596802.587973:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1789596802.588010:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964830208 00000100:00100000:3.0:1789596802.588014:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964830208 00000100:00100000:3.0:1789596802.588048:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964829952 00000100:00100000:3.0:1789596802.588052:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964829952 00000100:00100000:3.0:1789596802.588071:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789596802.588078:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876527964830208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596802.588248:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789596802.588256:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964830336:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789596802.588358:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789596802.588364:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596802.588391:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7810da1-eaae-414b-ba87-f9d6f005a55b:3307:1876527964829824:0@lo:400:kworker.0 00000100:00100000:2.0:1789596802.588427:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789596802.588435:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964829952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596802.588518:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964830080:0@lo:400:kworker.0 00000100:00100000:0.0:1789596802.588579:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964830336:12345-0@lo:400:kworker.0 Request processed in 324us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596802.588586:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789596802.588620:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964830336:0@lo:400:kworker.0 00000100:00100000:2.0:1789596802.591573:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964829952:12345-0@lo:400:kworker.0 Request processed in 3129us (3771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596802.591592:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789596802.591777:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964829952:0@lo:400:kworker.0 00000100:00100000:3.0:1789596802.598083:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876527964830208:12345-0@lo:400:kworker.0 Request processed in 9993us (10536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596802.598099:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789596802.598371:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876527964830208:0@lo:400:kworker.0 00000100:00100000:1.0:1789596802.598501:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596802.598586:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964830080 00000100:00100000:0.0:1789596802.598595:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964830080 00000100:00100000:0.0:1789596802.598670:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789596802.598679:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964830080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596802.598759:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964830080:12345-0@lo:400:kworker.0 Request processed in 81us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596802.598767:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:2.0:1789596802.598840:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596802.599108:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964830080:0@lo:400:kworker.0 00010000:00010000:2.0:1789596802.971001:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596803.101537:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964830464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596803.101625:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596803.101775:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964830464 00000100:00100000:2.0:1789596803.101785:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964830464 00000100:00100000:2.0:1789596803.101861:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789596803.101871:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964830464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789596803.101908:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789596803.101958:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964830464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596803.101964:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789596803.102060:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964830464:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789596803.995525:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596804.463262:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596804.463509:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944928896 00000100:00100000:0.0:1789596804.463520:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944928896 00000100:00100000:0.0:1789596804.463615:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 66 00000100:00100000:0.0:1789596804.463627:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+18:12305:x1876527944928896:12345-192.168.202.44@tcp:35:umount.0 00000100:00100000:0.0:1789596804.464082:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:12305:x1876527944928896:12345-192.168.202.44@tcp:35:umount.0 Request processed in 455us (827us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789596804.464090:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 66 00000100:00080000:2.0:1789596804.464367:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596804.470944:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596804.471047:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944929152 00000100:00100000:2.0:1789596804.471057:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944929152 00000100:00100000:2.0:1789596804.471121:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 67 00000100:00100000:2.0:1789596804.471131:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+19:12305:x1876527944929152:12345-192.168.202.44@tcp:35:umount.0 00000100:00100000:2.0:1789596804.471462:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:12305:x1876527944929152:12345-192.168.202.44@tcp:35:umount.0 Request processed in 331us (525us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789596804.471469:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 67 00000100:00100000:1.0:1789596804.483287:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596804.483436:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944929408 00000100:00100000:2.0:1789596804.483447:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944929408 00000100:00100000:2.0:1789596804.483514:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 68 00000100:00100000:2.0:1789596804.483526:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c3550c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+20:12305:x1876527944929408:12345-192.168.202.44@tcp:35:umount.0 00000100:00100000:2.0:1789596804.483953:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c3550c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:12305:x1876527944929408:12345-192.168.202.44@tcp:35:umount.0 Request processed in 427us (673us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789596804.483961:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 68 00000100:00100000:0.0:1789596804.503182:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596804.503352:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944929664 00000100:00100000:3.0:1789596804.503362:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944929664 00000100:00100000:3.0:1789596804.503425:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 69 00000100:00100000:3.0:1789596804.503436:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:12305:x1876527944929664:12345-192.168.202.44@tcp:35:umount.0 00000100:00100000:3.0:1789596804.503857:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:12305:x1876527944929664:12345-192.168.202.44@tcp:35:umount.0 Request processed in 420us (682us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789596804.503876:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 69 00000100:00100000:0.0:1789596804.507782:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596804.507881:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596804.507904:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596804.507937:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596804.507967:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944930048 00000100:00100000:0.0:1789596804.507977:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944930048 00000100:00100000:0.0:1789596804.508034:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944929920 00000100:00100000:0.0:1789596804.508037:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944929920 00000100:00100000:0.0:1789596804.508051:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944930176 00000100:00100000:0.0:1789596804.508054:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944930176 00000100:00100000:0.0:1789596804.508070:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 17 00000100:00100000:0.0:1789596804.508079:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d5fac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+15:2354:x1876527944930048:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596804.508095:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596804.508128:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f88200/0x8973ae90b38d7917 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c51 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596804.508154:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596804.508219:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d5fac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+14:2354:x1876527944930048:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 140us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596804.508227:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 17 00000100:00100000:0.0:1789596804.508274:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 18 00000100:00100000:0.0:1789596804.508281:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+13:2354:x1876527944929920:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596804.508289:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596804.508298:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8ef427400/0x8973ae90b38d79b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c89 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596804.508308:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596804.508325:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:2354:x1876527944929920:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 45us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596804.508331:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 18 00000100:00100000:0.0:1789596804.508343:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 19 00000100:00100000:0.0:1789596804.508349:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+11:2354:x1876527944930176:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596804.508358:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596804.508367:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f89400/0x8973ae90b38d7b9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d54 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596804.508375:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596804.508390:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2354:x1876527944930176:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 42us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596804.508396:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 19 00000100:00100000:2.0:1789596804.508990:0:9219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944929792 00000100:00100000:2.0:1789596804.508998:0:9219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944929792 00000100:00100000:2.0:1789596804.509062:0:9219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 72 00000100:00100000:2.0:1789596804.509081:0:9219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2350:x1876527944929792:12345-192.168.202.44@tcp:9:umount.0 00000020:00000080:2.0:1789596804.509117:0:9219:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7c89 00000100:00080000:2.0:1789596804.509128:0:9219:0:(import.c:65:import_set_state_nolock()) ffff9ea8c3eec000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789596804.509180:0:9219:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1789596804.509451:0:9219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1fdd0e7b-fe25-4537-b350-ae6aecfab059+2:2350:x1876527944929792:12345-192.168.202.44@tcp:9:umount.0 Request processed in 371us (1679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596804.509459:0:9219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 72 00010000:00010000:2.0:1789596804.509478:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789596804.510983:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596804.525305:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596804.525493:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944930560 00000100:00100000:3.0:1789596804.525503:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944930560 00000100:00100000:3.0:1789596804.525580:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 73 00000100:00100000:3.0:1789596804.525602:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+7:2350:x1876527944930560:12345-192.168.202.44@tcp:9:umount.0 00000020:00000080:3.0:1789596804.525634:0:6693:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7ef1 00000020:00010000:3.0:1789596804.525641:0:6693:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ea8d2e19800: total 0 00000100:00080000:3.0:1789596804.525646:0:6693:0:(import.c:65:import_set_state_nolock()) ffff9ea8d2e1a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789596804.525690:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:0.0:1789596804.526059:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596804.530254:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1fdd0e7b-fe25-4537-b350-ae6aecfab059+5:2350:x1876527944930560:12345-192.168.202.44@tcp:9:umount.0 Request processed in 4653us (4946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596804.530270:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 73 00000020:00010000:2.0:1789596804.530566:0:5829:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ea8d2e19800: total 0 00010000:00010000:2.0:1789596804.530625:0:5829:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ea8d2e19800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789596804.530686:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ba9fc74/0x8973ae90b38d828d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f29 expref: 4 pid: 9219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596804.530727:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b56b9f9/0x8973ae90b38d891d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450f0 expref: 3 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596804.530743:0:5829:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ea8d2e19800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789596804.530756:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596804.530758:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596804.530760:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596804.546388:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596804.546632:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944931584 00000100:00100000:3.0:1789596804.546642:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944931584 00000100:00100000:3.0:1789596804.546710:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 239 00000100:00100000:3.0:1789596804.546722:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+22:2350:x1876527944931584:12345-192.168.202.44@tcp:39:umount.0 00000020:00000080:3.0:1789596804.546755:0:5841:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7925 00000020:00010000:3.0:1789596804.546775:0:5841:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ea900076000: total 0 00000100:00080000:3.0:1789596804.546780:0:5841:0:(import.c:65:import_set_state_nolock()) ffff9ea900070800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789596804.546812:0:5841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1789596804.547245:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1fdd0e7b-fe25-4537-b350-ae6aecfab059+21:2350:x1876527944931584:12345-192.168.202.44@tcp:39:umount.0 Request processed in 523us (865us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789596804.547254:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 239 00000020:00010000:2.0:1789596804.547730:0:7643:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ea900076000: total 0 00010000:00010000:2.0:1789596804.547781:0:7643:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ea900076000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789596804.547836:0:7643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:2.0:1789596804.547840:0:7643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596804.547849:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482600/0x8973ae90b38d816e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344edc expref: 20 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596804.547902:0:7643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:2.0:1789596804.547905:0:7643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789596804.547909:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031000/0x8973ae90b38d85dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345017 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596804.547923:0:7643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:2.0:1789596804.547925:0:7643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789596804.547929:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8908 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450e9 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596804.547940:0:7643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:2.0:1789596804.547942:0:7643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596804.547945:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7a00/0x8973ae90b38d87fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450a3 expref: 17 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596804.547956:0:7643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ea8d55e5d00) 00010000:00010000:2.0:1789596804.547958:0:7643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789596804.547962:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d82fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f45 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596804.547978:0:7643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ea8d55e5800) 00010000:00010000:2.0:1789596804.547981:0:7643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596804.547985:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d7c0b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d69 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596804.548000:0:7643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:2.0:1789596804.548002:0:7643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789596804.548013:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c1482400/0x8973ae90b38d8278 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f22 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596804.548029:0:7643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:2.0:1789596804.548032:0:7643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596804.548035:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d824e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f14 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596804.548050:0:7643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ea8e0eeaf00) 00010000:00010000:2.0:1789596804.548052:0:7643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789596804.548056:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427200/0x8973ae90b38d7bef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d62 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596804.548069:0:7643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ea8d1438200) 00010000:00010000:2.0:1789596804.548072:0:7643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596804.548075:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33600/0x8973ae90b38d88de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450db expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596804.548092:0:7643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:2.0:1789596804.548100:0:7643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789596804.548104:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32400/0x8973ae90b38d7c5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d7e expref: 10 pid: 10902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596804.548116:0:7643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8d1438400) 00010000:00010000:2.0:1789596804.548118:0:7643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789596804.548122:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88c00/0x8973ae90b38d82e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344f3e expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596804.548132:0:7643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:2.0:1789596804.548150:0:7643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789596804.548156:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8d5f88800/0x8973ae90b38d7f4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344e50 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596804.548170:0:7643:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ea900076000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1789596804.548184:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596804.548186:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596804.548187:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596805.019507:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596805.481724:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596805.481795:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596805.481922:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944931712 00000100:00100000:1.0:1789596805.481932:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944931712 00000100:00100000:1.0:1789596805.482000:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 300 00000100:00100000:1.0:1789596805.482012:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c611b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2354:x1876527944931712:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596805.482111:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c611b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2354:x1876527944931712:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 102us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596805.482119:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 300 00000100:00100000:2.0:1789596805.482332:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944931840 00000100:00100000:2.0:1789596805.482338:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944931840 00000100:00100000:2.0:1789596805.482388:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 166 00000100:00100000:2.0:1789596805.482396:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+6:2354:x1876527944931840:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596805.482430:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+6:2354:x1876527944931840:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 36us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596805.482437:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 166 00000100:00080000:1.0:1789596805.482667:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1789596805.718726:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1fdd0e7b-fe25-4537-b350-ae6aecfab059 00000020:00000080:0.0:1789596805.718736:0:7655:0:(genops.c:885:class_export_put()) final put ffff9ea8c3ee9800/1fdd0e7b-fe25-4537-b350-ae6aecfab059 00000020:00000080:0.0:1789596805.718761:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c3ee9800/1fdd0e7b-fe25-4537-b350-ae6aecfab059 for lustre-OST0001 00000020:00000080:0.0:1789596805.718805:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea8c3eec000 for lustre-OST0001 00010000:00010000:2.0:1789596806.043174:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596806.774880:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596806.774924:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596806.774975:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596806.775006:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944931968 00000100:00100000:1.0:1789596806.775015:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944931968 00000100:00100000:1.0:1789596806.775065:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944932224 00000100:00100000:1.0:1789596806.775068:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944932224 00000100:00100000:1.0:1789596806.775096:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944932096 00000100:00100000:1.0:1789596806.775099:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944932096 00000100:00100000:1.0:1789596806.775125:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 20 00000100:00100000:1.0:1789596806.775135:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa658a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+12:2352:x1876527944931968:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596806.775150:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596806.775171:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d79f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c9e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596806.775188:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596806.775239:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa658a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+11:2352:x1876527944931968:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 106us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596806.775246:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 20 00000100:00100000:1.0:1789596806.775266:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 21 00000100:00100000:1.0:1789596806.775272:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa65b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+10:2352:x1876527944932224:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596806.775280:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596806.775289:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d7b94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344d4d expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596806.775298:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596806.775313:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa65b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+9:2352:x1876527944932224:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 42us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596806.775319:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 21 00000100:00100000:1.0:1789596806.775331:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 22 00000100:00100000:1.0:1789596806.775343:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+8:2352:x1876527944932096:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789596806.775350:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596806.775358:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d79fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344cc8 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596806.775367:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596806.775384:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+7:2352:x1876527944932096:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 41us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596806.775388:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 22 00000100:00100000:0.0:1789596806.787985:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596806.788529:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944932480 00000100:00100000:3.0:1789596806.788540:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944932480 00000100:00100000:3.0:1789596806.788612:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 240 00000100:00100000:3.0:1789596806.788622:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+6:2350:x1876527944932480:12345-192.168.202.44@tcp:39:umount.0 00000020:00000080:3.0:1789596806.788674:0:5841:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7a0c 00000020:00010000:3.0:1789596806.788685:0:5841:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ea8f6591000: total 0 00000100:00080000:3.0:1789596806.788691:0:5841:0:(import.c:65:import_set_state_nolock()) ffff9ea8f6594000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789596806.788725:0:5841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1789596806.789218:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3+5:2350:x1876527944932480:12345-192.168.202.44@tcp:39:umount.0 Request processed in 594us (1238us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789596806.789226:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 240 00000020:00010000:2.0:1789596806.789880:0:7643:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ea8f6591000: total 0 00010000:00010000:2.0:1789596806.789885:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596806.789935:0:7643:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ea8f6591000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789596806.789970:0:7643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8d1438400) 00010000:00010000:2.0:1789596806.789974:0:7643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789596806.789984:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426600/0x8973ae90b38d892b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3450f7 expref: 4 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596806.790010:0:7643:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ea8f6591000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789596806.790020:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596806.790022:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596806.790024:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596806.815141:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596806.815294:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944932736 00000100:00100000:2.0:1789596806.815305:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944932736 00000100:00100000:2.0:1789596806.815364:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 301 00000100:00100000:2.0:1789596806.815374:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+7:2350:x1876527944932736:12345-192.168.202.44@tcp:251:umount.0 00000020:00000080:2.0:1789596806.815422:0:5836:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7902 00000020:00010000:2.0:1789596806.815430:0:5836:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ea900075000: total 0 00000100:00080000:2.0:1789596806.815435:0:5836:0:(import.c:65:import_set_state_nolock()) ffff9ea900074800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789596806.815516:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d497c431-e5b0-455f-b1ef-a9fda826a9b9+3:2350:x1876527944932736:12345-192.168.202.44@tcp:251:umount.0 Request processed in 144us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596806.815524:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 301 00000020:00010000:3.0:1789596806.816138:0:5830:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ea900075000: total 0 00010000:00010000:3.0:1789596806.816182:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ea900075000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789596806.816217:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8c0030a00/0x8973ae90b38d79b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c344c90 expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596806.816233:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ea900075000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789596806.816258:0:5830:0:(genops.c:885:class_export_put()) final put ffff9ea900075000/d497c431-e5b0-455f-b1ef-a9fda826a9b9 00010000:00010000:3.0:1789596806.816281:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596806.816283:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596806.816285:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789596806.816371:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea900075000/d497c431-e5b0-455f-b1ef-a9fda826a9b9 for MGS 00000020:00000080:0.0:1789596806.816416:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea900074800 for MGS 00010000:00010000:1.0:1789596807.071894:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596807.205873:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964830592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596807.205959:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596807.206146:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964830592 00000100:00100000:2.0:1789596807.206156:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964830592 00000100:00100000:2.0:1789596807.206220:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789596807.206232:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964830592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596807.206266:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789596807.211731:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964830592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5492us (5761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596807.211747:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1789596807.211793:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596807.218255:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964830592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596807.708684:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964831104:0@lo:400:kworker.0 00000100:00100000:3.0:1789596807.708749:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596807.708800:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596807.708807:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964830976:0@lo:400:kworker.0 00000100:00100000:3.0:1789596807.709092:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596807.709214:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964831104 00000100:00100000:3.0:1789596807.709223:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964831104 00000100:00100000:3.0:1789596807.709271:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964830976 00000100:00100000:3.0:1789596807.709274:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964830976 00000100:00100000:3.0:1789596807.709296:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789596807.709304:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964831104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596807.709356:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964831104:12345-0@lo:400:kworker.0 Request processed in 52us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596807.709364:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789596807.709380:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789596807.709387:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964830976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596807.709412:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964830976:12345-0@lo:400:kworker.0 Request processed in 27us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596807.709416:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789596807.709467:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964830976:0@lo:400:kworker.0 00000100:00100000:3.0:1789596807.709958:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964831104:0@lo:400:kworker.0 00000100:00100000:2.0:1789596807.710152:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964830720:0@lo:400:kworker.0 00000100:00100000:2.0:1789596807.710192:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596807.710227:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964831232:0@lo:400:kworker.0 00000100:00100000:2.0:1789596807.710250:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596807.710271:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596807.710277:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964830848:0@lo:400:kworker.0 00000100:00100000:2.0:1789596807.710298:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596807.710325:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964830848 00000100:00100000:2.0:1789596807.710336:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964830848 00000100:00100000:2.0:1789596807.710365:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789596807.710371:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964830848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596807.710407:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964830848:12345-0@lo:400:kworker.0 Request processed in 37us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596807.710413:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:2.0:1789596807.710430:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596807.710442:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964830720 00000100:00100000:2.0:1789596807.710445:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964830720 00000100:00100000:2.0:1789596807.710470:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789596807.710476:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964830720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596807.710504:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3306:x1876527964830720:12345-0@lo:400:kworker.0 Request processed in 28us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596807.710511:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1789596807.710537:0:12484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964831232 00000100:00100000:2.0:1789596807.710541:0:12484:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964831232 00000100:00100000:2.0:1789596807.710570:0:12484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789596807.710576:0:12484:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964831232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596807.710604:0:12484:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964831232:12345-0@lo:400:kworker.0 Request processed in 28us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596807.710610:0:12484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1789596807.710634:0:5837:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596807.710654:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964830848:0@lo:400:kworker.0 00000100:00100000:2.0:1789596807.710662:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964830720:0@lo:400:kworker.0 00000100:00100000:2.0:1789596807.710670:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964831232:0@lo:400:kworker.0 00010000:00010000:2.0:1789596808.092018:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596808.222312:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964831360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596808.222375:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596808.222440:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964831360 00000100:00100000:0.0:1789596808.222447:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964831360 00000100:00100000:0.0:1789596808.222489:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789596808.222497:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964831360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596808.222531:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596808.222575:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964831360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596808.222582:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789596808.222629:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964831360:0@lo:13:osp-pre-1-0.0 00000020:01000004:2.0:1789596808.598672:0:12977:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789596808.626279:0:12977:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789596808.626327:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d7987 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d798e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.626341:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d7987 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d798e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.626349:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d7987 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d798e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.626367:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d7987 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d798e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.626386:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789596808.626392:0:12977:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789596808.626419:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789596808.626423:0:12977:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789596808.626430:0:12977:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789596808.626457:0:12977:0:(import.c:65:import_set_state_nolock()) ffff9ea8c6e46800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789596808.626969:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876527964831488:0@lo:39:umount.0 00000100:00100000:0.0:1789596808.627052:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789596808.627652:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596808.627662:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d7987 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d798e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.627671:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426a00 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:3.0:1789596808.627675:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d7987 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d798e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.627685:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d7987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x8973ae90b38d798e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596808.627693:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d7987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x8973ae90b38d798e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596808.627700:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789596808.627703:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789596808.627705:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789596808.627747:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d7987 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8973ae90b38d798e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.627755:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596808.627788:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d7987 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8973ae90b38d798e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.627795:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d7987 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8973ae90b38d798e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.627808:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596808.627857:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596808.627859:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596808.627876:0:10902:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964831488 00000100:00100000:3.0:1789596808.627884:0:10902:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964831488 00000100:00100000:3.0:1789596808.627934:0:10902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789596808.627944:0:10902:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876527964831488:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789596808.627970:0:10902:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7711 00000100:00080000:3.0:1789596808.628056:0:10902:0:(import.c:65:import_set_state_nolock()) ffff9ea8f9f64000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789596808.628154:0:10902:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1876527964831488:12345-0@lo:39:umount.0 Request processed in 212us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596808.628161:0:10902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:3.0:1789596808.628171:0:10902:0:(genops.c:885:class_export_put()) final put ffff9ea8f9f63800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1789596808.628194:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596808.628209:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964831616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596808.628241:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789596808.628278:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789596808.628289:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8f9f63800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789596808.628337:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea8f9f64000 for lustre-MDT0000 00000100:00100000:3.0:1789596808.628350:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964831616 00000100:00100000:3.0:1789596808.628354:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964831616 00000100:00100000:3.0:1789596808.628386:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789596808.628392:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa447100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3309:x1876527964831616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596808.628401:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596808.628414:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f89000/0x8973ae90b38d798e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8973ae90b38d7987 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.628426:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596808.628451:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa447100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:3309:x1876527964831616:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596808.628468:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789596808.628507:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964831616:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789596808.628535:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8c6e46800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789596808.628545:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876527964831488:0@lo:39:umount.0 00000100:00080000:0.0:1789596808.628865:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789596808.628870:0:12977:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789596808.628874:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789596808.630199:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030600/0x8973ae90b38d7995 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d799c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.630215:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030600/0x8973ae90b38d7995 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d799c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.630222:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030600/0x8973ae90b38d7995 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d799c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.630229:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030600/0x8973ae90b38d7995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d799c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.630255:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596808.630275:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8600/0x8973ae90b38d78bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d78c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.630283:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8600/0x8973ae90b38d78bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d78c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.630290:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8600/0x8973ae90b38d78bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d78c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.630299:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8600/0x8973ae90b38d78bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d78c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.630311:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789596808.630317:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d7bbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7bc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.630325:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d7bbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7bc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.630332:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d7bbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d7bc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.630339:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d7bbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d7bc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.630349:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789596808.630354:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483e00/0x8973ae90b38d7670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7677 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.630361:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483e00/0x8973ae90b38d7670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7677 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.630375:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483e00/0x8973ae90b38d7670 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d7677 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.630382:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483e00/0x8973ae90b38d7670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d7677 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596808.630391:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1789596808.630394:0:12977:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1789596808.630421:0:12977:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789596808.630425:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789596808.630429:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789596808.630435:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:0.0:1789596808.630442:0:12977:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9ea8ef42d800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789596808.630448:0:12977:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9ea8ff5bc000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789596808.630456:0:12977:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9ea8f6591000 aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3 192.168.202.44@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789596808.630461:0:12977:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9ea900076000 1fdd0e7b-fe25-4537-b350-ae6aecfab059 192.168.202.44@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:0.0:1789596808.630466:0:12977:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9ea8c2ca4d40) has exports, disconnecting them 00000020:00080000:0.0:1789596808.630470:0:12977:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ea8ef42d800), last request at 1789596807 00000020:00000080:0.0:1789596808.630478:0:12977:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7884 00000100:00080000:0.0:1789596808.630498:0:12977:0:(import.c:65:import_set_state_nolock()) ffff9ea8ef42f000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789596808.630548:0:12977:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ea8ef42d800): rc 0 00000020:00000080:0.0:1789596808.630551:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8ef42d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1789596808.630559:0:12977:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ea8ff5bc000), last request at 1789596807 00000020:00000080:0.0:1789596808.630562:0:12977:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d77b9 00000100:00080000:0.0:1789596808.630568:0:12977:0:(import.c:65:import_set_state_nolock()) ffff9ea8ff5bb800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789596808.630573:0:12977:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ea8ff5bc000): rc 0 00000020:00000080:0.0:1789596808.630581:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8ff5bc000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1789596808.630589:0:12977:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc02840d87ae0 00000100:00080000:0.0:1789596808.630606:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789596808.630609:0:12977:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1789596808.630624:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789596808.630696:0:12977:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789596808.630717:0:12977:0:(import.c:65:import_set_state_nolock()) ffff9ea8ff34d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1789596808.630877:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789596808.630884:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030600/0x8973ae90b38d7995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d799c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.630892:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030600 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:3.0:1789596808.630896:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030600/0x8973ae90b38d7995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d799c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.630905:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030600/0x8973ae90b38d7995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x8973ae90b38d799c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596808.630913:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030600/0x8973ae90b38d7995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x8973ae90b38d799c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596808.630919:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789596808.630922:0:7643:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1789596808.630924:0:7643:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1789596808.630952:0:7643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030600/0x8973ae90b38d7995 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8973ae90b38d799c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.630958:0:7643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596808.631178:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030600/0x8973ae90b38d7995 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8973ae90b38d799c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.631200:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030600/0x8973ae90b38d7995 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8973ae90b38d799c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.631215:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789596808.631219:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8600/0x8973ae90b38d78bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d78c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.631224:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f8600 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:3.0:1789596808.631227:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8600/0x8973ae90b38d78bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d78c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.631233:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8600/0x8973ae90b38d78bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8973ae90b38d78c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596808.631240:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8600/0x8973ae90b38d78bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8973ae90b38d78c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596808.631244:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789596808.631247:0:7643:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789596808.631248:0:7643:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789596808.631263:0:7643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8600/0x8973ae90b38d78bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8973ae90b38d78c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.631269:0:7643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596808.631285:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8600/0x8973ae90b38d78bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8973ae90b38d78c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.631292:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8600/0x8973ae90b38d78bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8973ae90b38d78c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.631314:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789596808.631318:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d7bbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d7bc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.631324:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031400 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:3.0:1789596808.631326:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d7bbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d7bc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.631333:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d7bbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8973ae90b38d7bc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596808.631340:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d7bbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8973ae90b38d7bc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596808.631345:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789596808.631347:0:7643:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789596808.631349:0:7643:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789596808.631362:0:7643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d7bbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8973ae90b38d7bc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.631368:0:7643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596808.631375:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d7bbe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8973ae90b38d7bc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.631381:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031400/0x8973ae90b38d7bbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8973ae90b38d7bc5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.631390:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596808.631393:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483e00/0x8973ae90b38d7670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d7677 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.631405:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c1483e00 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:3.0:1789596808.631407:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483e00/0x8973ae90b38d7670 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d7677 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.631413:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483e00/0x8973ae90b38d7670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8973ae90b38d7677 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789596808.631419:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483e00/0x8973ae90b38d7670 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8973ae90b38d7677 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596808.631423:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789596808.631425:0:7643:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789596808.631427:0:7643:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789596808.631440:0:7643:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483e00/0x8973ae90b38d7670 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8973ae90b38d7677 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.631445:0:7643:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789596808.631452:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483e00/0x8973ae90b38d7670 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8973ae90b38d7677 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.631458:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c1483e00/0x8973ae90b38d7670 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8973ae90b38d7677 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.631470:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596808.631472:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596808.631474:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596808.631483:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789596808.631491:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8ef42d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789596808.631530:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8ff5bc000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789596808.631563:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea8ef42f000 for lustre-MDT0000 00000020:00000080:3.0:1789596808.631567:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea8ff5bb800 for lustre-MDT0000 00000100:00100000:3.0:1789596808.631587:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964831872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596808.631653:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596808.631700:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789596808.631707:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964832256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596808.631806:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596808.632224:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964832000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596808.632251:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596808.632270:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596808.632276:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964832128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596808.632298:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596808.632335:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964831872 00000100:00100000:3.0:1789596808.632343:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964831872 00000100:00100000:3.0:1789596808.632378:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964832256 00000100:00100000:3.0:1789596808.632381:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964832256 00000100:00100000:3.0:1789596808.632390:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964832000 00000100:00100000:3.0:1789596808.632393:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964832000 00000100:00100000:3.0:1789596808.632401:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964832128 00000100:00100000:3.0:1789596808.632403:0:7644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964832128 00000100:00100000:3.0:1789596808.632420:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789596808.632428:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d5fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7810da1-eaae-414b-ba87-f9d6f005a55b+21:3309:x1876527964831872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596808.632442:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596808.632457:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea9021f9000/0x8973ae90b38d799c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8973ae90b38d7995 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.632471:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596808.632506:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d5fadc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7810da1-eaae-414b-ba87-f9d6f005a55b+20:3309:x1876527964831872:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596808.632524:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789596808.632570:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789596808.632576:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa445500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7810da1-eaae-414b-ba87-f9d6f005a55b+19:3309:x1876527964832256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596808.632584:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596808.632593:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea902044e00/0x8973ae90b38d7677 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8973ae90b38d7670 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.632606:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596808.632627:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa445500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7810da1-eaae-414b-ba87-f9d6f005a55b+18:3309:x1876527964832256:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596808.632633:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789596808.632644:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789596808.632650:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa446d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7810da1-eaae-414b-ba87-f9d6f005a55b+17:3306:x1876527964832000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596808.632657:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596808.632664:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8c1482c00/0x8973ae90b38d78c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8973ae90b38d78bc expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.632673:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596808.632698:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa446d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7810da1-eaae-414b-ba87-f9d6f005a55b+16:3306:x1876527964832000:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596808.632704:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789596808.632715:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789596808.632720:0:7644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa447480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7810da1-eaae-414b-ba87-f9d6f005a55b+15:3306:x1876527964832128:12345-0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789596808.632935:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789596808.632940:0:12977:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1789596808.632951:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789596808.633296:0:12977:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789596808.633317:0:12977:0:(import.c:65:import_set_state_nolock()) ffff9ea8ffa3b000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789596808.633351:0:12977:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9ea8c2ca4d40) has no exports 00010000:00010000:1.0:1789596808.634517:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596808.634937:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596808.634963:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea9021f9600/0x8973ae90b38d7bc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8973ae90b38d7bbe expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596808.635010:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596808.635977:0:7644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa447480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7810da1-eaae-414b-ba87-f9d6f005a55b+14:3306:x1876527964832128:12345-0@lo:103:ldlm_bl.0 Request processed in 3252us (3676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596808.635988:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789596808.636045:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964832128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596808.636055:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7810da1-eaae-414b-ba87-f9d6f005a55b:3306:1876527964832000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789596808.636231:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964831744:0@lo:9:umount.0 00000100:00100000:3.0:1789596808.636276:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596808.636308:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964832384:0@lo:9:umount.0 00000100:00100000:3.0:1789596808.636329:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596808.636366:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964831744 00000100:00100000:3.0:1789596808.636374:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964831744 00000100:00100000:3.0:1789596808.636411:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964832384 00000100:00100000:3.0:1789596808.636415:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964832384 00000100:00100000:3.0:1789596808.636440:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789596808.636449:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876527964831744:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789596808.636477:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7806 00000100:00080000:3.0:1789596808.636488:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9ea8ff5be800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789596808.636522:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789596808.638321:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3305:x1876527964831744:12345-0@lo:9:umount.0 Request processed in 1866us (2037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596808.638333:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789596808.638354:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789596808.638364:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876527964832384:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789596808.638401:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d78ed 00000100:00080000:3.0:1789596808.638411:0:6692:0:(import.c:65:import_set_state_nolock()) ffff9ea8f90ef000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789596808.638441:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789596808.638704:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3305:x1876527964832384:12345-0@lo:9:umount.0 Request processed in 343us (2373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596808.638711:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1789596808.638911:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8ff34d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789596808.638928:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789596808.638930:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789596808.638935:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964831744:0@lo:9:umount.0 00000100:00080000:0.0:1789596808.638947:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8ffa3b000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789596808.638957:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789596808.638959:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789596808.638963:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964832384:0@lo:9:umount.0 00000100:00100000:2.0:1789596808.639373:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964832256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596808.639383:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964831872:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789596808.639485:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596808.639492:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789596808.653155:0:12977:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9ea8c2ca4d40) has no exports 00000020:00000080:2.0:1789596808.706049:0:12977:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d76cb 00000020:00000080:2.0:1789596808.706136:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8f9f60000/lustre-QMT0000_UUID 00000020:01000000:2.0:1789596808.706161:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789596808.706214:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8f9f60000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789596808.706292:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789596808.706305:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789596808.706309:0:12977:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9ea8f745cd40) has no exports 00000020:00000080:3.0:1789596808.706532:0:12977:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d76c4 00000020:00000080:3.0:1789596808.706539:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8f7461800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789596808.706608:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789596808.706616:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789596808.706618:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8f7467800/lustre-QMT0000_UUID 00000020:00000080:3.0:1789596808.706620:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8f7467800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789596808.706628:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1789596808.706787:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8f7461800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1789596809.115677:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789596809.322366:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000001:00080000:2.0:1789596809.322384:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:2.0:1789596809.322392:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3 00000001:00080000:2.0:1789596809.322398:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1789596809.322401:0:5863:0:(genops.c:885:class_export_put()) final put ffff9ea8f6591000/aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3 00000001:00100000:2.0:1789596809.322417:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1fdd0e7b-fe25-4537-b350-ae6aecfab059 00000001:00080000:2.0:1789596809.322421:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1789596809.322424:0:5863:0:(genops.c:885:class_export_put()) final put ffff9ea900076000/1fdd0e7b-fe25-4537-b350-ae6aecfab059 00000020:00000080:2.0:1789596809.322440:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8f6591000/aca7e8e0-b73b-4512-ae4b-e7fc539ed5a3 for lustre-MDT0000 00000020:00000080:2.0:1789596809.322486:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea900076000/1fdd0e7b-fe25-4537-b350-ae6aecfab059 for lustre-MDT0000 00000020:00000080:2.0:1789596809.322517:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea8f6594000 for lustre-MDT0000 00000020:00000080:2.0:1789596809.322522:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea900070800 for lustre-MDT0000 00000001:00100000:3.0:1789596809.332415:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789596809.332425:0:6719:0:(genops.c:885:class_export_put()) final put ffff9ea8ff5bc800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789596809.332455:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1fdd0e7b-fe25-4537-b350-ae6aecfab059 00000020:00000080:3.0:1789596809.332457:0:6719:0:(genops.c:885:class_export_put()) final put ffff9ea8d2e19800/1fdd0e7b-fe25-4537-b350-ae6aecfab059 00000020:00000080:2.0:1789596809.332969:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8ff5bc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789596809.333039:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8d2e19800/1fdd0e7b-fe25-4537-b350-ae6aecfab059 for lustre-OST0000 00000020:00000080:2.0:1789596809.333066:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea8ff5be800 for lustre-OST0000 00000020:00000080:2.0:1789596809.333071:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea8d2e1a800 for lustre-OST0000 00010000:00010000:3.0:1789596810.141224:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789596810.714994:0:12977:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ea8ff87f480 - data ffff9ea8ffc991b0/ffff9ea8fa1f1800 00000020:01000000:3.0:1789596810.715197:0:12977:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ea8c4edcc60 - data ffff9ea8c5c390d8/ffff9ea8e484b400 00000001:00000004:3.0:1789596810.732269:0:12977:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000001:00100000:1.0:1789596810.853743:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789596810.853752:0:7655:0:(genops.c:885:class_export_put()) final put ffff9ea8c86d2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789596810.853835:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c86d2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789596810.853882:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea8f90ef000 for lustre-OST0001 00000100:00080000:2.0:1789596810.889658:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789596810.889667:0:12977:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1789596810.889700:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789596810.889703:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789596810.890121:0:6999:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789596810.890126:0:6999:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1789596810.890136:0:6999:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789596810.891926:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789596810.891933:0:12977:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1789596810.891946:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789596810.891948:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789596810.893715:0:8104:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789596810.893723:0:8104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1789596810.893737:0:8104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789596811.011465:0:12977:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7693 00000020:00000080:0.0:1789596811.011478:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8c6f6c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789596811.012187:0:12977:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d76a8 00000020:00000080:0.0:1789596811.012195:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8c6f6d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789596811.012201:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789596811.012207:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789596811.012216:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789596811.012220:0:12977:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9ea8c2ca0000) has no exports 00000020:00000080:1.0:1789596811.012344:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c6f6c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789596811.012356:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c6f6d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1789596811.012524:0:12977:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789596811.012534:0:12977:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d78e6 00000020:00000080:0.0:1789596811.012542:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8c358a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789596811.012590:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789596811.012595:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789596811.012602:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789596811.012604:0:12977:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9ea8ffa84d40) has no exports 00000020:00000080:0.0:1789596811.012610:0:12977:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d78df 00000020:00000080:0.0:1789596811.012613:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8ffa3e000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789596811.018057:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c358a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1789596811.021491:0:12977:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789596811.021499:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789596811.021503:0:12977:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1789596811.021511:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789596811.021514:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789596811.021549:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596811.021562:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789596811.021569:0:12977:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d77ff 00000020:00000080:0.0:1789596811.021578:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8c86d2000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789596811.021583:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789596811.021591:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789596811.021595:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789596811.021599:0:12977:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9ea8c6e219c0) has no exports 00000020:00000080:0.0:1789596811.021604:0:12977:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d77f8 00000020:00000080:0.0:1789596811.021608:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8ff348800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1789596811.022175:0:12977:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789596811.022178:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789596811.022191:0:12977:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1789596811.022195:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789596811.022197:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789596811.022237:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596811.022243:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789596811.022270:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596811.022273:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789596811.022277:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8f90ee800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789596811.022281:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8f90ee800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789596811.022288:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789596811.022452:0:12977:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d76af 00000020:00000080:0.0:1789596811.022457:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8c6f6f000/lustre-MDD0000_UUID 00000020:01000000:0.0:1789596811.022462:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789596811.022466:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789596811.022470:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789596811.022473:0:12977:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9ea9007b3380) has no exports 00000020:00000080:0.0:1789596811.022491:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596811.022494:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789596811.022497:0:12977:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d76b6 00000020:00000080:0.0:1789596811.022500:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8c6f6e800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789596811.022507:0:12977:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ea8e4942800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789596811.022510:0:12977:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ea8e4942800 3 00000020:01000004:0.0:1789596811.022513:0:12977:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ea8e4942800 from lustre-MDT0000 00000020:00000080:0.0:1789596811.022531:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596811.022534:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789596811.022537:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8c6f6d000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789596811.022539:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c6f6d000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789596811.022545:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789596811.022570:0:12977:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1789596811.022574:0:12977:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789596811.022576:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789596811.022579:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789596811.022587:0:12977:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789596811.022593:0:12977:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9ea8c7f32000 d7810da1-eaae-414b-ba87-f9d6f005a55b 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789596811.022598:0:12977:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9ea8c34019c0) has exports, disconnecting them 00000020:00080000:0.0:1789596811.022602:0:12977:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9ea8c7f32000), last request at 1789596588 00000020:00000080:0.0:1789596811.022616:0:12977:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d764d 00000020:00010000:0.0:1789596811.022620:0:12977:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9ea8c7f32000: total 5 00000100:00080000:0.0:1789596811.022623:0:12977:0:(import.c:65:import_set_state_nolock()) ffff9ea8c7f34800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789596811.022649:0:12977:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ea8c7f32000): rc 0 00000020:00080000:0.0:1789596811.022653:0:12977:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9ea8c34019c0) has no exports 00000100:00100000:0.0:1789596811.022714:0:5834:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ea8d5787000:5834] 0 exiting: rc = 1 00000020:00010000:2.0:1789596811.022962:0:7643:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9ea8c7f32000: total 5 00010000:00010000:2.0:1789596811.022998:0:7643:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ea8c7f32000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1789596811.023027:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f88a00/0x8973ae90b38d7956 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8973ae90b38d794f expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596811.023043:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f89a00/0x8973ae90b38d7964 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8973ae90b38d795d expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596811.023054:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f88000/0x8973ae90b38d7980 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8973ae90b38d7979 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596811.023064:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8c0031c00/0x8973ae90b38d7972 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8973ae90b38d796b expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596811.023083:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea9021f9200/0x8973ae90b38d7ba9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8973ae90b38d7ba2 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596811.023094:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8c0030000/0x8973ae90b38d79aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8973ae90b38d79a3 expref: 4 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596811.023109:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8ef427600/0x8973ae90b38d7bb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8973ae90b38d7bb0 expref: 3 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596811.023122:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea902044000/0x8973ae90b38d776c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8973ae90b38d7765 expref: 2 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596811.023149:0:7643:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ea8c7f32000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1789596811.023163:0:7643:0:(genops.c:885:class_export_put()) final put ffff9ea8c7f32000/d7810da1-eaae-414b-ba87-f9d6f005a55b 00010000:00010000:2.0:1789596811.023169:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596811.023171:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596811.023172:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596811.023197:0:5835:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9ea8c34cd400:5835] 1 exiting: rc = 0 00000100:00100000:2.0:1789596811.023265:0:5836:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9ea8d5f8d000:5836] 2 exiting: rc = 0 00000100:00100000:2.0:1789596811.023336:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023346:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023357:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023366:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023373:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023379:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023385:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023394:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023402:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023412:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023419:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023430:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023437:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023448:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023458:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023469:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023478:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023484:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023503:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023512:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023519:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023525:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023531:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023537:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023543:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023556:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023562:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023568:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023574:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023579:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023585:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023590:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023595:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023600:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023605:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023610:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023615:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023620:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023625:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023631:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023637:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023642:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023647:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023654:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023660:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023665:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023671:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023677:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023684:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023689:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023694:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023700:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023705:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023711:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023718:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023723:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023730:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023736:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023743:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023748:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023762:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023768:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023773:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.023779:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1789596811.024170:0:12977:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789596811.024174:0:12977:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:1.0:1789596811.024648:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8ffa3e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789596811.024662:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea8ffa3b000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789596811.024670:0:37:0:(genops.c:885:class_export_put()) final put ffff9ea8ffa3f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789596811.024672:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8ffa3f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789596811.024677:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789596811.024736:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c86d2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789596811.024742:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8ff348800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789596811.024749:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea8ff34d000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789596811.024762:0:37:0:(genops.c:885:class_export_put()) final put ffff9ea8ff8bc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789596811.024764:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8ff8bc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789596811.024767:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789596811.024871:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c6f6f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789596811.024876:0:37:0:(genops.c:885:class_export_put()) final put ffff9ea8c6f6a800/lustre-MDD0000_UUID 00000020:00000080:1.0:1789596811.024878:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c6f6a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789596811.024881:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789596811.025034:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c6f6e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789596811.025039:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c7f32000/d7810da1-eaae-414b-ba87-f9d6f005a55b for MGS 00000020:00000080:1.0:1789596811.025065:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea8c7f34800 for MGS 00000020:01000000:1.0:1789596811.027064:0:12977:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ea8ff87f900 - data ffff9ea8ffc99000/ffff9ea8ef53cc00 00000020:01000000:1.0:1789596811.027174:0:12977:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ea8d107d1e0 - data ffff9ea8ebb68bd0/ffff9ea8c5193000 00000020:00000080:1.0:1789596811.027640:0:12977:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7638 00000020:00000080:1.0:1789596811.027649:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8c7f34000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789596811.027673:0:12977:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ea8e4942800 from MGS, refs=2 00000020:01000004:1.0:1789596811.027676:0:12977:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ea8e4942800 2 00000020:01000004:1.0:1789596811.027680:0:12977:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ea8e4942800 from MGS 00000020:00000080:1.0:1789596811.027705:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789596811.027712:0:12977:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789596811.027714:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8c7f36800/MGS 00000020:00000080:1.0:1789596811.027716:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c7f36800/MGS for MGS 00000020:01000000:1.0:1789596811.027722:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789596811.027772:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789596811.027776:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789596811.027781:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789596811.027788:0:12977:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9ea8f7460000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789596811.027794:0:12977:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9ea9007b19c0) has exports, disconnecting them 00000020:00080000:1.0:1789596811.027798:0:12977:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9ea8f7460000), last request at 1789596589 00000020:00000080:1.0:1789596811.027802:0:12977:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7703 00000020:00000080:2.0:1789596811.027972:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c7f34000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1789596811.028038:0:12977:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ea8f7460000): rc 0 00000020:00000080:1.0:1789596811.028044:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8f7460000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789596811.028735:0:12977:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789596811.028741:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789596811.028745:0:12977:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789596811.028751:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789596811.030684:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8f7460000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789596811.031837:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789596811.031851:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789596811.031859:0:12977:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ea8e4942800 1 00000020:00000080:1.0:1789596811.031866:0:12977:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d762a 00000020:00000080:1.0:1789596811.031876:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8c50f2000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789596811.032193:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea8c6e46800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789596811.032202:0:38:0:(genops.c:885:class_export_put()) final put ffff9ea8c6f6e000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789596811.032204:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c6f6e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789596811.032210:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:1.0:1789596811.033231:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789596811.033242:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789596811.033248:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789596811.033253:0:12977:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9ea8c6e23380) has no exports 00000020:00000080:2.0:1789596811.039630:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c50f2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789596811.045505:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596811.045522:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789596811.045529:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8c76fa000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789596811.045533:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c76fa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789596811.045540:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789596811.045683:0:12977:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ea8c76fb000 00000020:01000000:0.0:1789596811.045706:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789596811.045711:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789596811.045717:0:12977:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789596811.045722:0:12977:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9ea8c2ca19c0) has no exports 00000100:00100000:3.0:1789596811.049547:0:10902:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9ea8c30c8a00:10902] 3 exiting: rc = 0 00000100:00100000:3.0:1789596811.049690:0:5843:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9ea8c7f78e00:5843] 2 exiting: rc = 0 00000100:00100000:0.0:1789596811.051095:0:5841:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9ea8c7f78200:5841] 0 exiting: rc = 1 00000100:00100000:0.0:1789596811.051302:0:5842:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9ea8c7f79c00:5842] 1 exiting: rc = 0 00000100:00100000:0.0:1789596811.069386:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069397:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069403:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069409:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069417:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069423:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069430:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069449:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069458:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069467:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069490:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069499:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069507:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069516:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069524:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069533:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069541:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069548:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069556:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069563:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069571:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069580:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069587:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069595:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069601:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069607:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069619:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069630:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069638:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069650:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069659:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069703:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069710:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069717:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069722:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069729:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069736:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069742:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069748:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069754:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069760:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069766:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069773:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069779:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069785:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069798:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069805:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069972:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069978:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069984:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.069991:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.070068:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.070091:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.070097:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.070103:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.070109:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.070115:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.070120:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.070126:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.070131:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.070136:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.070142:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.070147:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.070162:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081200:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9ea8c30a4a00:5844] 0 exiting: rc = 1 00000100:00100000:2.0:1789596811.081355:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ea8c30a4e00:5845] 1 exiting: rc = 0 00000100:00100000:0.0:1789596811.081449:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081458:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081463:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081470:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081478:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081483:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081490:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081495:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081501:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081506:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081513:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081523:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081529:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081534:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081540:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081560:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081564:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081569:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081574:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081580:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081584:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081589:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081594:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081598:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081603:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081608:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081612:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081617:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081622:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081626:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081631:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081636:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081640:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081645:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081651:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081656:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081662:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081667:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081671:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081676:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081680:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081685:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081691:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081695:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081700:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081704:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081709:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081714:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081720:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081725:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081737:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081742:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081747:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081752:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081758:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081763:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081769:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081774:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081779:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081785:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081791:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081797:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081801:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.081806:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.082791:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9ea8c30a4c00:5847] 1 exiting: rc = 0 00000100:00100000:0.0:1789596811.083321:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9ea8c30a5600:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1789596811.083416:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083432:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083440:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083446:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083454:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083461:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083468:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083476:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083483:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083491:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083498:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083505:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083511:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083532:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083540:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083546:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083553:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083559:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083566:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083573:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083593:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083599:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083605:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083613:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083620:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083641:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083649:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083656:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083663:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083669:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083676:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083682:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083688:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083695:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083703:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083711:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083718:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083742:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083750:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083758:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083764:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083771:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083777:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083784:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083790:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083798:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083805:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083903:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083910:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083932:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083941:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083948:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083955:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083961:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083969:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083982:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.083990:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.084056:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.084065:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.084268:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.084279:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.084285:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.084293:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.084308:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.106971:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ea8c30a5800:5849] 1 exiting: rc = 0 00000100:00100000:3.0:1789596811.115928:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ea8c30a4000:5848] 0 exiting: rc = 1 00000100:00100000:0.0:1789596811.116201:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116209:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116214:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116220:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116226:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116232:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116237:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116242:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116247:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116252:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116257:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116262:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116267:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116273:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116278:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116284:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116289:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116295:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116301:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116306:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116312:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116317:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116322:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116328:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116332:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116346:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116352:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116357:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116361:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116366:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116371:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116376:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116381:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116386:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116392:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116397:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116402:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116407:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116413:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116417:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116423:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116428:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116434:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116438:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116444:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116448:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116453:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116459:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116464:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116470:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116475:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116480:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116486:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116491:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116495:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116500:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116505:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116510:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116515:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116520:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116532:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116538:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116543:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116548:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.116920:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ea8d5f8ce00:5851] 1 exiting: rc = 0 00000100:00100000:2.0:1789596811.120582:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ea8d5f8dc00:5850] 0 exiting: rc = 1 00000100:00100000:0.0:1789596811.121884:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.121894:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.121900:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.121906:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.121912:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.121919:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.121925:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.121931:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.121937:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.121942:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.121947:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.121953:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.121959:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.121964:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.121970:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.121974:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.121980:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.121986:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.121992:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.121997:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122002:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122008:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122013:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122017:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122022:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122027:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122031:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122036:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122041:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122047:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122224:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122241:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122246:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122251:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122257:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122263:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122268:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122274:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122279:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122285:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122291:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122297:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122303:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122309:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122314:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122320:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122326:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122332:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122337:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122343:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122349:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122354:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122361:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122366:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122372:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122378:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122384:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122389:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122394:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122400:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122405:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122411:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122416:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122422:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.122813:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9ea8c3078800:5853] 1 exiting: rc = 0 00000100:00100000:2.0:1789596811.123222:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9ea8c312ee00:5852] 0 exiting: rc = 1 00000100:00100000:0.0:1789596811.123460:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123467:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123473:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123478:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123484:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123490:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123495:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123501:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123506:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123512:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123517:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123523:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123529:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123535:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123540:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123545:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123550:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123555:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123560:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123565:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123571:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123576:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123582:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123587:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123593:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123598:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123604:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123609:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123614:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123620:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123625:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123630:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123635:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123642:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123648:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123665:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123670:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123676:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123682:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123688:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123694:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123700:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123706:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123711:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123717:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123722:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123728:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123734:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123740:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123745:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123751:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123756:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123762:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123767:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123773:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123779:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123785:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123791:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123797:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123803:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123808:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123848:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123855:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.123860:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596811.126195:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9ea8c5144200:5854] 0 exiting: rc = 1 00000100:00100000:0.0:1789596811.126537:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9ea8c3079600:5855] 1 exiting: rc = 0 00000100:00100000:0.0:1789596811.126719:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9ea8c3078c00:5856] 2 exiting: rc = 0 00000100:00100000:0.0:1789596811.126777:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126784:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126790:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126794:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126862:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126885:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126892:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126897:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126903:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126908:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126913:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126918:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126923:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126929:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126934:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126938:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126943:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126950:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126955:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126960:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126965:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126971:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126977:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126982:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126988:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.126994:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127000:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127005:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127010:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127031:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127039:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127045:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127051:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127057:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127062:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127067:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127167:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127175:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127181:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127194:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127199:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127205:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127211:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127216:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127223:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127294:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127303:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127309:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127313:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127319:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127325:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127330:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127336:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127358:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127364:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127369:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127374:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127381:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127386:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127391:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127397:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127402:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127408:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789596811.127413:0:12977:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789596811.138417:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596811.138431:0:12977:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789596811.138438:0:12977:0:(genops.c:885:class_export_put()) final put ffff9ea8c2ce2000/MDS_uuid 00000020:00000080:0.0:1789596811.138442:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c2ce2000/MDS_uuid for MDS 00000020:01000000:0.0:1789596811.138451:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789596811.138597:0:12977:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1789596811.164621:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596812.191455:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596812.830621:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964832512:0@lo:400:kworker.0 00000400:00000100:2.0:1789596812.830673:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876527964832512 offset 0 length 224: 4 00000100:00100000:2.0:1789596812.830735:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964832640:0@lo:400:kworker.0 00000400:00000100:2.0:1789596812.830755:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527964832640 offset 0 length 224: 4 00000100:00100000:2.0:1789596812.830769:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596812.830774:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964832768:0@lo:400:kworker.0 00000400:00000100:2.0:1789596812.830789:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527964832768 offset 0 length 224: 4 00010000:00010000:0.0:1789596813.225570:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789596813.747512:0:13131:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789596813.778100:0:13131:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789596813.778153:0:13131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9c00/0x8973ae90b38d796b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7972 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596813.778169:0:13131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9c00/0x8973ae90b38d796b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7972 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596813.778177:0:13131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9c00/0x8973ae90b38d796b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d7972 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596813.778184:0:13131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9c00/0x8973ae90b38d796b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d7972 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596813.778220:0:13131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789596813.778225:0:13131:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789596813.778245:0:13131:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789596813.778258:0:13131:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ea8f6570380 x1876527964832640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596828 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596813.778277:0:13131:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789596813.778284:0:13131:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1789596813.778451:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596813.778459:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9c00/0x8973ae90b38d796b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d7972 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596813.778483:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f9c00 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:0.0:1789596813.778486:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9c00/0x8973ae90b38d796b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d7972 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596813.778495:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9c00/0x8973ae90b38d796b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x8973ae90b38d7972 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596813.778502:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9c00/0x8973ae90b38d796b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x8973ae90b38d7972 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596813.778508:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789596813.778511:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789596813.778513:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789596813.778569:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9c00/0x8973ae90b38d796b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8973ae90b38d7972 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596813.778575:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789596813.778598:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9c00/0x8973ae90b38d796b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8973ae90b38d7972 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596813.778604:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9c00/0x8973ae90b38d796b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8973ae90b38d7972 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596813.778617:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596813.778618:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596813.778620:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596813.778637:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964832896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789596813.778701:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596813.778774:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964832896 00000100:00100000:0.0:1789596813.778797:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964832896 00000100:00100000:0.0:1789596813.779036:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789596813.779043:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1876527964832896:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789596813.779058:0:5826:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789596813 with bad export cookie 9904451942028768845 00000100:00080000:3.0:1789596813.780513:0:13131:0:(import.c:65:import_set_state_nolock()) ffff9ea8ff349800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789596813.781507:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964832640:0@lo:400:kworker.0 00000100:00100000:1.0:1789596813.792390:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876527964833024:0@lo:39:umount.0 00000400:00000100:1.0:1789596813.792450:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527964833024 offset 0 length 224: 4 00000100:00100000:0.0:1789596813.792997:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1876527964832896:12345-0@lo:103:ldlm_bl.0 Request processed in 13951us (14293us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789596813.793009:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789596813.793512:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.144@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789596813.793519:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9ea8d276d000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789596813.793522:0:3308:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.144@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1789596813.801721:0:3308:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.144@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789596813.801728:0:3308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789596813.801738:0:3308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ea8f6573100 x1876527964832512/t0(0) o400->MGC192.168.202.144@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789596828 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596813.801856:0:3308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ea8c6ec3100 x1876527964832896/t0(0) o103->MGC192.168.202.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789596829 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789596813.801866:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789596813.801868:0:3308:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789596813.801870:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789596813.801874:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9ea8d276d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789596813.801878:0:3308:0:(import.c:545:import_select_connection()) MGC192.168.202.144@tcp: connect to NID 0@lo last attempt 173 00000100:00080000:2.0:1789596813.801895:0:3308:0:(import.c:666:import_select_connection()) MGC192.168.202.144@tcp: import ffff9ea8d276d000 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:2.0:1789596813.801934:0:3308:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ea8f6572680 x1876527964833152/t0(0) o250->MGC192.168.202.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789596813.801972:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7810da1-eaae-414b-ba87-f9d6f005a55b:3308:1876527964832896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789596813.802100:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d7810da1-eaae-414b-ba87-f9d6f005a55b:3305:1876527964833152:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1789596813.802149:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876527964833152 offset 0 length 520: 4 00000100:00100000:0.0:1789596813.802950:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7810da1-eaae-414b-ba87-f9d6f005a55b:3309:1876527964832512:0@lo:400:kworker.0 00010000:00010000:0.0:1789596814.235454:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596815.259103:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596816.285090:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596817.308928:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789596817.947052:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) d7810da1-eaae-414b-ba87-f9d6f005a55b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789596817.947064:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) d7810da1-eaae-414b-ba87-f9d6f005a55b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789596817.947213:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596817.947236:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964833280:0@lo:400:kworker.0 00000400:00000100:3.0:1789596817.947292:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527964833280 offset 0 length 224: 4 00010000:00010000:0.0:1789596818.331922:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789596818.971236:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) d7810da1-eaae-414b-ba87-f9d6f005a55b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789596818.971245:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) d7810da1-eaae-414b-ba87-f9d6f005a55b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789596818.971505:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964833408:0@lo:400:kworker.0 00000400:00000100:3.0:1789596818.971560:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527964833408 offset 0 length 224: 4 00010000:00010000:3.0:1789596819.356060:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596820.379063:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596821.404603:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596822.428383:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596823.067673:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596813/real 1789596813] req@ffff9ea8f6572680 x1876527964833152/t0(0) o250->MGC192.168.202.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789596823 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596823.067723:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ea8f6572680 x1876527964833152/t0(0) o250->MGC192.168.202.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789596823 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596823.067735:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596813/real 1789596813] req@ffff9ea8fa447100 x1876527964833024/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789596823 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596823.067747:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ea8fa447100 x1876527964833024/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789596823 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789596823.067766:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8d276d000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789596823.067807:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789596823.067811:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6572680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d7810da1-eaae-414b-ba87-f9d6f005a55b:3305:1876527964833152:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1789596823.067835:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8ff349800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789596823.067854:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876527964833024:0@lo:39:umount.0 00000100:00080000:2.0:1789596823.068113:0:13131:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789596823.068119:0:13131:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789596823.068123:0:13131:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789596823.069443:0:13131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d7979 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7980 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596823.069462:0:13131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d7979 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7980 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596823.069470:0:13131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d7979 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d7980 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596823.069490:0:13131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d7979 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d7980 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596823.069511:0:13131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596823.069520:0:13131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d7bb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7bb7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596823.069527:0:13131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d7bb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7bb7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596823.069534:0:13131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d7bb0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d7bb7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596823.069540:0:13131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d7bb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d7bb7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596823.069553:0:13131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789596823.069556:0:13131:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789596823.069584:0:13131:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789596823.069588:0:13131:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789596823.069593:0:13131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789596823.069598:0:13131:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789596823.069602:0:13131:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9ea9007b0000) has no exports 00000020:00080000:2.0:1789596823.069625:0:13131:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9ea9007b0000) has no exports 00000100:00080000:3.0:1789596823.070036:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) d7810da1-eaae-414b-ba87-f9d6f005a55b->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789596823.070041:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789596823.070044:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ea8d276d000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789596823.070051:0:38:0:(import.c:545:import_select_connection()) MGC192.168.202.144@tcp: connect to NID 0@lo last attempt 398 00000100:00080000:3.0:1789596823.070056:0:38:0:(import.c:630:import_select_connection()) MGC192.168.202.144@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789596823.070068:0:38:0:(import.c:666:import_select_connection()) MGC192.168.202.144@tcp: import ffff9ea8d276d000 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:3.0:1789596823.070098:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ea8fa445f80 x1876527964833536/t0(0) o250->MGC192.168.202.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789596823.070161:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876527964833664:0@lo:400:kworker.0 00000400:00000100:3.0:1789596823.070208:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527964833664 offset 0 length 224: 4 00010000:00010000:0.0:1789596823.070299:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789596823.070306:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d7979 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d7980 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596823.070315:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88e00 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:0.0:1789596823.070319:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d7979 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d7980 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596823.070328:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d7979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8973ae90b38d7980 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596823.070336:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d7979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8973ae90b38d7980 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596823.070342:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789596823.070344:0:7643:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789596823.070347:0:7643:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1789596823.070373:0:7643:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ea8d276d000 00010000:00010000:0.0:1789596823.070378:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d7979 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8973ae90b38d7980 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596823.070384:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d7979 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x8973ae90b38d7980 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596823.070399:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596823.070411:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d7bb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d7bb7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596823.070418:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f9e00 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:0.0:1789596823.070421:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d7bb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d7bb7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596823.070427:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d7bb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8973ae90b38d7bb7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596823.070435:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d7bb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8973ae90b38d7bb7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596823.070439:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789596823.070442:0:7643:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789596823.070444:0:7643:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789596823.070450:0:7643:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ea8d276d000 00010000:00010000:0.0:1789596823.070453:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d7bb0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8973ae90b38d7bb7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596823.070459:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea9021f9e00/0x8973ae90b38d7bb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8973ae90b38d7bb7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596823.070467:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596823.070469:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596823.070470:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596823.070480:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d7810da1-eaae-414b-ba87-f9d6f005a55b:3305:1876527964833536:0@lo:250:kworker.0 00000400:00000100:0.0:1789596823.070503:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876527964833536 offset 0 length 520: 4 00010000:00010000:1.0:1789596823.070570:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789596823.085569:0:13131:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ea8c306a660 - data ffff9ea8ffcd50d8/ffff9ea8f67ff400 00000020:01000000:2.0:1789596823.085747:0:13131:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ea8e1724120 - data ffff9ea8c5c83bd0/ffff9ea8ff9c8400 00100000:10000000:1.0:1789596823.108946:0:13131:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789596823.161860:0:13131:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7788 00000020:00000080:1.0:1789596823.161872:0:13131:0:(genops.c:885:class_export_put()) final put ffff9ea8c3eea000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789596823.161888:0:13131:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ea8f9e94000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789596823.161892:0:13131:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ea8f9e94000 2 00000020:01000004:1.0:1789596823.161896:0:13131:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ea8f9e94000 from lustre-OST0000 00000020:00000080:1.0:1789596823.161923:0:13131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789596823.161948:0:13131:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789596823.161952:0:13131:0:(genops.c:885:class_export_put()) final put ffff9ea8c3eeb000/lustre-OST0000_UUID 00000020:00000080:1.0:1789596823.161955:0:13131:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c3eeb000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789596823.161975:0:13131:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789596823.162019:0:13131:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789596823.162024:0:13131:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789596823.162028:0:13131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789596823.162034:0:13131:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789596823.162041:0:13131:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9ea8ff5b8800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789596823.162048:0:13131:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9ea8f7458000) has exports, disconnecting them 00000020:00080000:1.0:1789596823.162053:0:13131:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9ea8ff5b8800), last request at 1789596607 00000020:00000080:1.0:1789596823.162058:0:13131:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d77b2 00000020:00080000:1.0:1789596823.162068:0:13131:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ea8ff5b8800): rc 0 00000020:00000080:1.0:1789596823.162073:0:13131:0:(genops.c:885:class_export_put()) final put ffff9ea8ff5b8800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789596823.163317:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c3eea000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789596823.163342:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8ff5b8800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789596823.171295:0:13131:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789596823.171306:0:13131:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789596823.171328:0:13131:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789596823.171336:0:13131:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789596823.171538:0:13131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789596823.171546:0:13131:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789596823.171554:0:13131:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ea8f9e94000 1 00000020:00000080:2.0:1789596823.171560:0:13131:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7742 00000020:00000080:2.0:1789596823.171568:0:13131:0:(genops.c:885:class_export_put()) final put ffff9ea8c6e43000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789596823.171574:0:13131:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789596823.171579:0:13131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789596823.171582:0:13131:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789596823.171586:0:13131:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9ea8f745b380) has no exports 00000020:00000080:3.0:1789596823.171661:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea8ff349800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789596823.171669:0:38:0:(genops.c:885:class_export_put()) final put ffff9ea8ff5b8000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789596823.171672:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8ff5b8000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789596823.171678:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789596823.171742:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c6e43000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789596823.237860:0:13131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789596823.237877:0:13131:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789596823.237883:0:13131:0:(genops.c:885:class_export_put()) final put ffff9ea8f9e97000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789596823.237888:0:13131:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8f9e97000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789596823.237895:0:13131:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789596823.238062:0:13131:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ea8f9e97800 00000020:02000400:3.0:1789596823.238127:0:13131:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1789596823.452423:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596824.477238:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596825.499736:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596826.524796:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789596826.577290:0:13281:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789596826.594328:0:13281:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789596826.594403:0:13281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d794f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7956 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596826.594418:0:13281:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d794f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7956 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596826.594426:0:13281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d794f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d7956 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596826.594434:0:13281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d794f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d7956 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596826.594460:0:13281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789596826.594475:0:13281:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789596826.594499:0:13281:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789596826.594510:0:13281:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ea8f6573b80 x1876527964832768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596828 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596826.594531:0:13281:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ea8c6ec1180 x1876527964833280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596833 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596826.594553:0:13281:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ea8fa65ad80 x1876527964833408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596834 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596826.594564:0:13281:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ea8fa444000 x1876527964833664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596839 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596826.594576:0:13281:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789596826.594582:0:13281:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789596826.594608:0:13281:0:(import.c:65:import_set_state_nolock()) ffff9ea90077e000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789596826.595335:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964833408:0@lo:400:kworker.0 00000100:00100000:3.0:1789596826.595356:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964832768:0@lo:400:kworker.0 00000100:00100000:3.0:1789596826.595395:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876527964833664:0@lo:400:kworker.0 00000100:00100000:0.0:1789596826.596119:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876527964833280:0@lo:400:kworker.0 00010000:00010000:2.0:1789596826.596263:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596826.596273:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d794f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d7956 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596826.596283:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030200 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596826.596287:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d794f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d7956 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596826.596299:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d794f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8973ae90b38d7956 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596826.596307:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d794f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8973ae90b38d7956 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596826.596313:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789596826.596315:0:7643:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789596826.596318:0:7643:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789596826.596335:0:7643:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ea8d276d000 00010000:00010000:2.0:1789596826.596339:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d794f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8973ae90b38d7956 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596826.596353:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c0030200/0x8973ae90b38d794f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8973ae90b38d7956 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596826.596368:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596826.596370:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596826.596372:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596826.596407:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876527964833792:0@lo:39:umount.0 00000400:00000100:3.0:1789596826.596460:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876527964833792 offset 0 length 224: 4 00010000:00010000:0.0:1789596827.547684:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789596828.187243:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) d7810da1-eaae-414b-ba87-f9d6f005a55b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789596828.187255:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) d7810da1-eaae-414b-ba87-f9d6f005a55b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1789596828.571013:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596829.595003:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596830.620406:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596831.644612:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596832.667458:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789596833.306969:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) d7810da1-eaae-414b-ba87-f9d6f005a55b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789596833.306980:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) d7810da1-eaae-414b-ba87-f9d6f005a55b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789596833.691319:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596834.715036:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596835.739169:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596836.763909:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596836.826995:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596826/real 1789596826] req@ffff9ea8fa65b800 x1876527964833792/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789596836 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596836.827028:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ea8fa65b800 x1876527964833792/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789596836 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789596836.827047:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea90077e000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789596836.827068:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876527964833792:0@lo:39:umount.0 00000100:00080000:1.0:1789596836.827164:0:13281:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789596836.827169:0:13281:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789596836.827173:0:13281:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789596836.828062:0:13281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8200/0x8973ae90b38d795d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7964 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596836.828076:0:13281:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8200/0x8973ae90b38d795d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7964 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596836.828084:0:13281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8200/0x8973ae90b38d795d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d7964 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596836.828092:0:13281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8200/0x8973ae90b38d795d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d7964 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596836.828118:0:13281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789596836.828140:0:13281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7ba2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d7ba9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596836.828148:0:13281:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7ba2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d7ba9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596836.828154:0:13281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7ba2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d7ba9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596836.828160:0:13281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7ba2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8973ae90b38d7ba9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596836.828183:0:13281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789596836.828188:0:13281:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789596836.828212:0:13281:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789596836.828216:0:13281:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789596836.828221:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789596836.828227:0:13281:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789596836.828231:0:13281:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9ea9007b4d40) has no exports 00000020:00080000:1.0:1789596836.828254:0:13281:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9ea9007b4d40) has no exports 00000020:01000000:1.0:1789596836.829908:0:13281:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ea8ff87f000 - data ffff9ea8c5f170d8/ffff9ea8fa1f2400 00000020:01000000:1.0:1789596836.830046:0:13281:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ea8f68f9600 - data ffff9ea8ffc46360/ffff9ea8ff3eb400 00010000:00010000:0.0:1789596836.830542:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789596836.830551:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8200/0x8973ae90b38d795d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d7964 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596836.830563:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f8200 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:0.0:1789596836.830578:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8200/0x8973ae90b38d795d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d7964 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596836.830591:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8200/0x8973ae90b38d795d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8973ae90b38d7964 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596836.830599:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8200/0x8973ae90b38d795d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8973ae90b38d7964 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596836.830604:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789596836.830607:0:7643:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1789596836.830610:0:7643:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1789596836.830626:0:7643:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ea8d276d000 00010000:00010000:0.0:1789596836.830630:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8200/0x8973ae90b38d795d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8973ae90b38d7964 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596836.830637:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8200/0x8973ae90b38d795d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8973ae90b38d7964 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596836.830652:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596836.830656:0:7643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7ba2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d7ba9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596836.830673:0:7643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426200 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:0.0:1789596836.830676:0:7643:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7ba2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8973ae90b38d7ba9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596836.830682:0:7643:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7ba2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8973ae90b38d7ba9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596836.830687:0:7643:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7ba2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8973ae90b38d7ba9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596836.830692:0:7643:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789596836.830694:0:7643:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789596836.830696:0:7643:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789596836.830702:0:7643:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ea8d276d000 00010000:00010000:0.0:1789596836.830705:0:7643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7ba2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8973ae90b38d7ba9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596836.830711:0:7643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d7ba2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8973ae90b38d7ba9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596836.830724:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596836.830726:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596836.830727:0:7643:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596836.830869:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789596836.841145:0:13281:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789596836.888632:0:13281:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7853 00000020:00000080:0.0:1789596836.888641:0:13281:0:(genops.c:885:class_export_put()) final put ffff9ea8ffa3d000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789596836.888665:0:13281:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ea8f66d1800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789596836.888669:0:13281:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ea8f66d1800 2 00000020:01000004:0.0:1789596836.888672:0:13281:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ea8f66d1800 from lustre-OST0001 00000020:00000080:0.0:1789596836.888694:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596836.888717:0:13281:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789596836.888721:0:13281:0:(genops.c:885:class_export_put()) final put ffff9ea8ff34f000/lustre-OST0001_UUID 00000020:00000080:0.0:1789596836.888724:0:13281:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8ff34f000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789596836.888730:0:13281:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789596836.888866:0:13281:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d7810da1-eaae-414b-ba87-f9d6f005a55b->MGS 00010000:00010000:0.0:1789596836.888883:0:13281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8c00/0x8973ae90b38d7765 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8973ae90b38d776c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596836.888895:0:13281:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8c00/0x8973ae90b38d7765 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8973ae90b38d776c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789596836.889073:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8ffa3d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1789596836.889112:0:13281:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789596836.889115:0:13281:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789596836.889118:0:13281:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789596836.889132:0:13281:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ea8d276d000 00010000:00010000:0.0:1789596836.889136:0:13281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea9021f8c00/0x8973ae90b38d7765 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8973ae90b38d776c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596836.889153:0:13281:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031200/0x8973ae90b38d79a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8973ae90b38d79aa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596836.889160:0:13281:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031200/0x8973ae90b38d79a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8973ae90b38d79aa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596836.889165:0:13281:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789596836.889167:0:13281:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789596836.889169:0:13281:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789596836.889178:0:13281:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ea8d276d000 00010000:00010000:0.0:1789596836.889181:0:13281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031200/0x8973ae90b38d79a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8973ae90b38d79aa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789596836.889197:0:13281:0:(import.c:65:import_set_state_nolock()) ffff9ea8d276d000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789596836.889207:0:13281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789596836.889210:0:13281:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789596836.889211:0:13281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789596836.889215:0:13281:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789596836.889226:0:13281:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ea8fa445f80 x1876527964833536/t0(0) o250->MGC192.168.202.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789596838 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789596836.889247:0:13281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789596836.889250:0:13281:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:3.0:1789596836.889313:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d7810da1-eaae-414b-ba87-f9d6f005a55b:3305:1876527964833536:0@lo:250:kworker.0 10000000:01000000:0.0:1789596836.889511:0:13281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789596836.889519:0:13281:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7646 00000020:00000080:0.0:1789596836.889524:0:13281:0:(genops.c:885:class_export_put()) final put ffff9ea8c4dce800/d7810da1-eaae-414b-ba87-f9d6f005a55b 00000020:01000000:0.0:1789596836.889539:0:13281:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.144@tcp (flags='') 00000020:00000080:0.0:1789596836.889544:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789596836.889549:0:13281:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.144@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789596836.889553:0:13281:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9ea8c2ca3380) has no exports 10000000:01000000:3.0:1789596836.889672:0:5838:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:2.0:1789596836.889756:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c4dce800/d7810da1-eaae-414b-ba87-f9d6f005a55b for MGC192.168.202.144@tcp 10000000:01000000:0.0:1789596836.891755:0:13281:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.144@tcp: client import never connected 00000100:00080000:0.0:1789596836.891762:0:13281:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789596836.891765:0:13281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789596836.891769:0:13281:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789596836.891772:0:13281:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789596836.891850:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789596836.891858:0:13281:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.144@tcp (uuid d7810da1-eaae-414b-ba87-f9d6f005a55b) 00000020:01000000:0.0:1789596836.891864:0:13281:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789596836.891872:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789596836.891877:0:13281:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789596836.891884:0:13281:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9ea90077c800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789596836.891890:0:13281:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff9ea8f66f4d40) has exports, disconnecting them 00000020:00080000:0.0:1789596836.891894:0:13281:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9ea90077c800), last request at 1789596624 00000020:00000080:0.0:1789596836.891908:0:13281:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d787d 00000020:00080000:0.0:1789596836.891920:0:13281:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ea90077c800): rc 0 00000020:00000080:0.0:1789596836.891925:0:13281:0:(genops.c:885:class_export_put()) final put ffff9ea90077c800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789596836.892538:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea8d276d000 for MGC192.168.202.144@tcp 00000020:00000080:2.0:1789596836.892548:0:38:0:(genops.c:885:class_export_put()) final put ffff9ea8c300b800/d7810da1-eaae-414b-ba87-f9d6f005a55b 00000020:00000080:2.0:1789596836.892551:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c300b800/d7810da1-eaae-414b-ba87-f9d6f005a55b for MGC192.168.202.144@tcp 00000020:01000000:2.0:1789596836.892556:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.144@tcp (d7810da1-eaae-414b-ba87-f9d6f005a55b) 00000020:00000080:2.0:1789596836.892830:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea90077c800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789596836.893868:0:13281:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789596836.893874:0:13281:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789596836.893878:0:13281:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789596836.893883:0:13281:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789596836.894068:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9ea90077e000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1789596836.897977:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789596836.898241:0:7643:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789596836.898448:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1789596836.900207:0:5824:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ea8c9320a00:5824] 0 exiting: rc = 1 00000100:00100000:2.0:1789596836.900313:0:5825:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ea8c3cea400:5825] 1 exiting: rc = 0 00000100:00100000:1.0:1789596836.901216:0:7642:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9ea90046ca00:7642] 2 exiting: rc = 0 00000100:00100000:3.0:1789596836.901414:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.901757:0:7644:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9ea8f6904a00:7644] 3 exiting: rc = 0 00000100:00100000:2.0:1789596836.901864:0:5827:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9ea8c6f36600:5827] 1 exiting: rc = 0 00000100:00100000:1.0:1789596836.902033:0:5828:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ea8c3593600:5828] 2 exiting: rc = 0 00000100:00100000:2.0:1789596836.902942:0:5826:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9ea8d5a87800:5826] 0 exiting: rc = 1 00000100:00100000:3.0:1789596836.903048:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903058:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903065:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903074:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903080:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903099:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903107:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903114:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903120:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903131:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903138:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903144:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903148:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903169:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903177:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903182:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903188:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903192:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903197:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903202:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903207:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903212:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903216:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903222:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903227:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903232:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903237:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903242:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903247:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903264:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903270:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903275:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903280:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903285:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903299:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903305:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903309:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903315:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903320:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903325:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903337:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903342:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903347:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903353:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903358:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903363:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903368:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903373:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903378:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903383:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903388:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903393:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903397:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903403:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903408:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903413:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903417:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903423:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903428:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903432:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903436:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903442:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903447:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.903452:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789596836.905065:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789596836.905075:0:13281:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789596836.905083:0:13281:0:(genops.c:885:class_export_put()) final put ffff9ea900071800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789596836.905087:0:13281:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea900071800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789596836.905098:0:13281:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1789596836.905144:0:13281:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ea8f66d1800 1 00000020:00000080:3.0:1789596836.905150:0:13281:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x8973ae90b38d7822 00000020:00000080:3.0:1789596836.905156:0:13281:0:(genops.c:885:class_export_put()) final put ffff9ea90077c000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789596836.905177:0:13281:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789596836.905182:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789596836.905194:0:13281:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789596836.905198:0:13281:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9ea8f66f0000) has no exports 00000020:00000080:2.0:1789596836.905481:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea90077c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789596836.918224:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789596836.918237:0:13281:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789596836.918243:0:13281:0:(genops.c:885:class_export_put()) final put ffff9ea8f66d4000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789596836.918247:0:13281:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8f66d4000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789596836.918261:0:13281:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789596836.918449:0:13281:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ea8f66d5000 00000020:01000000:3.0:1789596836.918476:0:13281:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789596836.918480:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789596836.918484:0:13281:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789596836.918488:0:13281:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9ea8f74599c0) has no exports 00000020:00000080:3.0:1789596836.918538:0:13281:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789596836.918544:0:13281:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789596836.918546:0:13281:0:(genops.c:885:class_export_put()) final put ffff9ea8c6e42000/OSS_uuid 00000020:00000080:3.0:1789596836.918549:0:13281:0:(genops.c:844:class_export_destroy()) destroying export ffff9ea8c6e42000/OSS_uuid for OSS 00000020:01000000:3.0:1789596836.918555:0:13281:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1789596836.918630:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9ea900060c00:6692] 0 exiting: rc = 1 00000100:00100000:3.0:1789596836.918717:0:6695:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9ea8c6e90a00:6695] 2 exiting: rc = 0 00000100:00080000:2.0:1789596836.923974:0:5837:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789596836.924176:0:12484:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff9ea8ff37ee00:12484] 4 exiting: rc = 0 00000100:00100000:2.0:1789596836.924431:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9ea8c6e91c00:6693] 1 exiting: rc = 0 00000100:00100000:2.0:1789596836.924492:0:9219:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9ea8c86e3800:9219] 3 exiting: rc = 0 00000100:00100000:3.0:1789596836.925597:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925607:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925613:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925619:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925625:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925630:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925635:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925640:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925645:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925652:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925657:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925662:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925667:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925672:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925677:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925695:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925701:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925706:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925712:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925716:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925722:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925727:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925731:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925736:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925741:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925747:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925751:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925757:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925762:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925768:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925775:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925781:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925787:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925792:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925797:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925802:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925807:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925812:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925849:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925856:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925864:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925869:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.925890:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926012:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926020:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926026:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926031:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926036:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926041:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926046:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926058:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926063:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926068:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926072:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926077:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926082:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926087:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926092:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926100:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926105:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926109:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926114:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926118:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.926123:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.928700:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9ea900062400:6697] 1 exiting: rc = 0 00000100:00100000:2.0:1789596836.928970:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9ea900063a00:6696] 0 exiting: rc = 1 00000100:00100000:3.0:1789596836.929229:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929238:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929243:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929258:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929265:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929270:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929275:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929281:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929285:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929303:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929310:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929315:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929320:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929325:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929331:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929336:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929341:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929346:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929350:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929355:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929376:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929381:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929386:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929390:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929395:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929401:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929406:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929412:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929417:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929422:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929427:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929432:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929437:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929442:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929447:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929452:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929458:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929463:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929468:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929472:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929477:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929482:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929487:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929492:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929497:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929501:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929506:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929511:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929516:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929521:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929526:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929531:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929537:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929542:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929547:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929560:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.929565:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.930549:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.930558:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.930564:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.930580:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.930587:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.930592:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.930598:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.931834:0:6699:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9ea900062200:6699] 1 exiting: rc = 0 00000100:00100000:2.0:1789596836.932053:0:6700:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9ea900062a00:6700] 2 exiting: rc = 0 00000100:00100000:3.0:1789596836.932471:0:6698:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ea900062800:6698] 0 exiting: rc = 1 00000100:00100000:3.0:1789596836.932530:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932537:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932544:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932551:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932558:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932564:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932728:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932738:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932743:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932749:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932755:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932760:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932775:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932782:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932790:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932796:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932803:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932808:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932856:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932865:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932873:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932879:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932885:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932891:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932965:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932989:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.932998:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933006:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933012:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933017:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933023:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933028:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933033:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933038:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933046:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933051:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933076:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933084:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933090:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933095:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933101:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933107:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933113:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933119:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933126:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933133:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933139:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933145:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933151:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933156:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933161:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933167:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933173:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933178:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933184:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933190:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933195:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933201:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933207:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933212:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933225:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933230:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933236:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789596836.933241:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596836.945263:0:6701:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9ea8f6716000:6701] 0 exiting: rc = 1 00000100:00100000:1.0:1789596836.945384:0:6702:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9ea8f6717800:6702] 1 exiting: rc = 0 00000100:00100000:2.0:1789596836.945513:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945521:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945526:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945532:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945537:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945542:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945548:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945553:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945559:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945564:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945583:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945589:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945594:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945599:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945604:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945610:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945615:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945620:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945625:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945642:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945647:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945652:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945657:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945661:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945667:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945672:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945677:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945682:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945688:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945693:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945699:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945704:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945709:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945714:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945719:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945723:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945728:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945732:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945737:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945742:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945747:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945752:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945757:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945763:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945768:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945774:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945779:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945785:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945791:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945796:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945801:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945806:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945811:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945848:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945863:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945868:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945873:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945878:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945883:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945888:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945893:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945909:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945916:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.945922:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789596836.947611:0:6703:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9ea8f6717000:6703] 0 exiting: rc = 1 00000100:00100000:1.0:1789596836.947712:0:6704:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9ea8f6717a00:6704] 1 exiting: rc = 0 00000100:00100000:2.0:1789596836.947876:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.947885:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.947892:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.947908:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.947914:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.947938:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.947946:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.947951:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.947956:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.947962:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.947968:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.947973:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.947979:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.947985:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.947991:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.947997:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948003:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948027:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948035:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948041:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948048:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948054:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948061:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948067:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948074:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948090:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948095:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948100:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948106:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948126:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948133:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948139:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948144:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948150:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948156:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948162:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948168:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948175:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948182:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948189:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948196:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948217:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948225:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948232:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948239:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948245:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948264:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948270:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948277:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948284:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948303:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948310:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948317:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948341:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948348:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948354:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948360:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948366:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948372:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948378:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948398:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948407:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948414:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789596836.948420:0:13281:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789596836.959431:0:13281:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789596855.002148:0:13897:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg244-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789596864.747973:0:14359:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789596864.747981:0:14359:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789596864.748104:0:14359:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ea7c29c1800 00000020:01000004:3.0:1789596864.748120:0:14359:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789596864.748128:0:14359:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789596864.748143:0:14359:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ea8f66f0000) 00000020:00000080:3.0:1789596864.748157:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789596864.793142:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789596864.804267:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1789596864.806013:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789596864.806103:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1789596864.806218:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1789596864.807749:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1789596864.807991:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1789596864.808099:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1789596864.808202:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1789596864.809768:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1789596864.816526:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 700: rc = 0 00100000:10000000:2.0:1789596864.816725:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 700: rc = 0 00100000:10000000:2.0:1789596864.817230:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 704: rc = 0 00100000:10000000:2.0:1789596864.818770:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 704: rc = 0 00100000:10000000:2.0:1789596864.819075:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 704: rc = 0 00100000:10000000:2.0:1789596864.819666:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 704: rc = 0 00100000:10000000:2.0:1789596864.819967:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 704: rc = 0 00100000:10000000:2.0:1789596864.820222:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 704: rc = 0 00100000:10000000:2.0:1789596864.820739:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 704: rc = 0 00100000:10000000:2.0:1789596864.821409:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 704: rc = 0 00100000:10000000:2.0:1789596864.821675:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 704: rc = 0 00100000:10000000:2.0:1789596864.821951:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 704: rc = 0 00100000:10000000:2.0:1789596864.822197:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 704: rc = 0 00100000:10000000:2.0:1789596864.823210:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 704: rc = 0 00100000:10000000:2.0:1789596864.823694:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 726: rc = 0 00100000:10000000:2.0:1789596864.823968:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 726: rc = 0 00100000:10000000:2.0:1789596864.824219:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 726: rc = 0 00100000:10000000:2.0:1789596864.824484:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 726: rc = 0 00100000:10000000:2.0:1789596864.825056:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 726: rc = 0 00100000:10000000:2.0:1789596864.825451:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 726: rc = 0 00100000:10000000:2.0:1789596864.825715:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 726: rc = 0 00100000:10000000:2.0:1789596864.830348:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 726: rc = 0 00100000:10000000:2.0:1789596864.830797:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 726: rc = 0 00100000:10000000:2.0:1789596864.831078:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 726: rc = 0 00100000:10000000:2.0:1789596864.831331:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 726: rc = 0 00100000:10000000:2.0:1789596864.833228:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 726: rc = 0 00100000:10000000:2.0:1789596864.834021:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 726: rc = 0 00100000:10000000:2.0:1789596864.834286:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 726: rc = 0 00100000:10000000:2.0:1789596864.834955:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 726: rc = 0 00100000:10000000:2.0:1789596864.835239:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 726: rc = 0 00100000:10000000:2.0:1789596864.835788:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 726: rc = 0 00100000:10000000:2.0:1789596864.836142:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 726: rc = 0 00100000:10000000:2.0:1789596864.836706:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 726: rc = 0 00100000:10000000:2.0:1789596864.837053:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 726: rc = 0 00100000:10000000:2.0:1789596864.837286:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 726: rc = 0 00100000:10000000:2.0:1789596864.837954:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 726: rc = 0 00100000:10000000:2.0:1789596864.838201:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 726: rc = 0 00100000:10000000:2.0:1789596864.838923:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 726: rc = 0 00100000:10000000:2.0:1789596864.839189:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 726: rc = 0 00100000:10000000:2.0:1789596864.839695:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 726: rc = 0 00100000:10000000:2.0:1789596864.840097:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 726: rc = 0 00100000:10000000:2.0:1789596864.840356:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 726: rc = 0 00100000:10000000:2.0:1789596864.842642:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 726: rc = 0 00100000:10000000:2.0:1789596864.843009:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 726: rc = 0 00100000:10000000:2.0:1789596864.843261:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 726: rc = 0 00100000:10000000:2.0:1789596864.844913:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 726: rc = 0 00100000:10000000:2.0:1789596864.846728:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 342: rc = 0 00100000:10000000:2.0:1789596864.847301:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789596864.848786:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 701: rc = 0 00100000:10000000:2.0:1789596864.849039:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789596864.849113:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 701: rc = 0 00100000:10000000:2.0:1789596864.849315:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789596864.850772:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 701: rc = 0 00100000:10000000:2.0:1789596864.851268:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789596864.852734:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 339: rc = 0 00100000:10000000:2.0:1789596864.853077:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789596864.853148:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 339: rc = 0 00100000:10000000:2.0:1789596864.854643:0:14359:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789596864.854754:0:14359:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 339: rc = 0 00000020:00000080:2.0:1789596864.856043:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789596864.856053:0:14359:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789596864.856064:0:14359:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8973ae90b38d8939 00000020:01000004:2.0:1789596864.856074:0:14359:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789596864.856079:0:14359:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789596864.856084:0:14359:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ea7c29c1800 from MGS 00000020:01000004:2.0:1789596864.856088:0:14359:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789596864.856099:0:14359:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9ea8ffa83380) 00000020:00000080:2.0:1789596864.856117:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789596864.856183:0:14359:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ea7c29c1800 from MGS, refs=2 00080000:01000000:2.0:1789596864.856189:0:14359:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789596864.856194:0:14359:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8973ae90b38d8947 00000100:00100000:2.0:1789596864.856291:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789596864.856423:0:14359:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789596864.856429:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789596864.861068:0:14359:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789596864.861083:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789596864.862003:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789596864.862178:0:14359:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789596864.862183:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789596864.863802:0:14359:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789596864.863813:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789596864.864188:0:14359:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789596864.864195:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789596864.865039:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596864.865043:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596864.865045:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596864.865641:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596864.865644:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596864.865646:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596864.871052:0:14359:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789596864.873679:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789596864.891791:0:14359:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789596864.891811:0:14359:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789596864.891929:0:14359:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789596864.893695:0:14368:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789596864.893963:0:14359:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789596864.894063:0:14359:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789596864.894524:0:14359:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789596864.895168:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789596864.895363:0:14359:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789596864.895662:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789596864.902153:0:14359:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789596864.902169:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789596864.902685:0:14359:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789596864.902693:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789596864.907178:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789596864.907203:0:14359:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.144@tcp' 00000020:01000004:0.0:1789596864.907205:0:14359:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789596864.907233:0:14359:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.144@tcp (typ=mgc) 00000020:00000080:0.0:1789596864.907245:0:14359:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.144@tcp (ffff9ea8c3400000) 00000020:00000080:0.0:1789596864.907259:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789596864.907346:0:14359:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ea8ef76a000@MGC192.168.202.144@tcp: add connection 192.168.202.144@tcp at head 00010000:00010000:0.0:1789596864.907880:0:14359:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.144@tcp-0 is initialized 00000040:01000000:0.0:1789596864.907887:0:14359:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.144@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789596864.909470:0:14374:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789596864.909531:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.144@tcp (uuid 725ddb85-e0d3-4aba-b101-0ba8e10978f0) 00000020:00000080:0.0:1789596864.909684:0:14359:0:(genops.c:1384:class_connect()) connect: client 725ddb85-e0d3-4aba-b101-0ba8e10978f0, cookie 0x8973ae90b38d8955 00000100:00080000:0.0:1789596864.909697:0:14359:0:(import.c:545:import_select_connection()) MGC192.168.202.144@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789596864.909709:0:14359:0:(import.c:666:import_select_connection()) MGC192.168.202.144@tcp: import ffff9ea8ef76a000 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:0.0:1789596864.909747:0:14359:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ea8c6ec1180 x1876527964833920/t0(0) o250->MGC192.168.202.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789596864.909809:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3305:1876527964833920:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789596864.909898:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789596864.910034:0:14359:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 725ddb85-e0d3-4aba-b101-0ba8e10978f0->MGS 00000020:01000004:0.0:1789596864.910063:0:14359:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789596864.910067:0:14359:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789596864.910079:0:14359:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9ea8c3404d40) 00000020:00000080:0.0:1789596864.910089:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:3.0:1789596864.913473:0:14373:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1789596864.923010:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964833920 00000100:00100000:1.0:1789596864.923027:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964833920 00000100:00100000:1.0:1789596864.923112:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789596864.923121:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8e0dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1876527964833920:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789596864.923151:0:14369:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 725ddb85-e0d3-4aba-b101-0ba8e10978f0@0@lo t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:1.0:1789596864.923184:0:14369:0:(genops.c:1384:class_connect()) connect: client 725ddb85-e0d3-4aba-b101-0ba8e10978f0, cookie 0x8973ae90b38d8963 00000100:00080000:1.0:1789596864.923323:0:14369:0:(import.c:65:import_set_state_nolock()) ffff9ea7c3997800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789596864.923417:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8e0dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+5:3305:x1876527964833920:12345-0@lo:250:mount.lustre.0 Request processed in 295us (13518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596864.923425:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789596864.927719:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789596864.927933:0:14359:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789596864.927940:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789596864.928934:0:3305:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.144@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789596864.928949:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.144@tcp: connect to target with instance 0 00000100:00080000:0.0:1789596864.928959:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.144@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789596864.928964:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789596864.928968:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8ef76a000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789596864.928971:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789596864.928975:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789596864.928984:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3305:1876527964833920:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789596864.933136:0:14359:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789596864.933173:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789596864.934763:0:14359:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789596864.934774:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789596864.937269:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789596864.937671:0:14359:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789596864.937678:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789596864.939299:0:14359:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789596864.939434:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789596864.982130:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789596864.982415:0:14359:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789596864.982423:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789596864.984185:0:14359:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789596864.984198:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789596864.985235:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789596864.986015:0:14359:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789596864.986024:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789596864.986734:0:14359:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789596864.986743:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789596864.987499:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789596864.988172:0:14359:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789596864.988178:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789596864.989456:0:14359:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789596864.989469:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789596864.990444:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789596864.991031:0:14359:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789596864.991038:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789596864.991756:0:14359:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789596864.991764:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789596865.017084:0:14359:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789596865.017286:0:14359:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789596865.017293:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789596865.019136:0:14359:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789596865.019157:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789596865.020306:0:14359:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789596865.020389:0:14359:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789596865.026767:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789596865.026795:0:14359:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789596865.026800:0:14359:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.144@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789596865.027154:0:14359:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.144@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789596865.027196:0:14359:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.144@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789596865.027201:0:14359:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789596865.027202:0:14359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789596865.027204:0:14359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596865.027205:0:14359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789596865.027206:0:14359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596865.027208:0:14359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596865.027209:0:14359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789596865.027210:0:14359:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789596865.027212:0:14359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596865.027214:0:14359:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789596865.027216:0:14359:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789596865.027218:0:14359:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789596865.027219:0:14359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789596865.027220:0:14359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596865.027221:0:14359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789596865.027222:0:14359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596865.027223:0:14359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596865.027224:0:14359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789596865.027225:0:14359:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789596865.027226:0:14359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596865.027227:0:14359:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789596865.027255:0:14359:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789596865.027277:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964834048:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789596865.027494:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596865.027803:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6137c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789596865.028030:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964834048 00000100:00100000:3.0:1789596865.028040:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964834048 00000100:00100000:3.0:1789596865.028133:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789596865.028144:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8e0df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+5:14359:x1876527964834048:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789596865.028193:0:14372:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789596865.028198:0:14372:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789596865.028200:0:14372:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1789596865.028805:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789596865.029276:0:14372:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1789596865.030863:0:14394:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789596865.030871:0:14394:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789596865.030873:0:14394:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789596865.030916:0:14394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1789596865.031511:0:14372:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789596865.031525:0:14372:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789596865.041106:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8e0df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+5:14359:x1876527964834048:12345-0@lo:253:mount.lustre.0 Request processed in 12955us (13602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596865.041124:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789596865.041232:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964834048:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789596865.041249:0:14359:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789596865.041264:0:14359:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789596865.041266:0:14359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789596865.041268:0:14359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596865.041269:0:14359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789596865.041270:0:14359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596865.041271:0:14359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596865.041273:0:14359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789596865.041274:0:14359:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789596865.041275:0:14359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596865.041277:0:14359:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789596865.041295:0:14359:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ea7c29c1800 from lustre-MDT0000 10000000:01000000:2.0:1789596865.041388:0:14359:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789596865.041392:0:14359:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789596865.041397:0:14359:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ea8c3400000 10000000:01000000:2.0:1789596865.041401:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789596865.041409:0:14359:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ea8c3400000 from 1 10000000:01000000:2.0:1789596865.041412:0:14359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789596865.041454:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d896a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.041466:0:14359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d896a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.041477:0:14359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d896a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596865.041496:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964834176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789596865.041788:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596865.041975:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6137cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596865.042085:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964834176 00000100:00100000:1.0:1789596865.042093:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964834176 00000100:00100000:1.0:1789596865.042171:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789596865.042181:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff40f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+5:14359:x1876527964834176:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789596865.042193:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596865.042215:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8f6a33e00/0x8973ae90b38d8971 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d896a expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.042239:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8f6a33e00/0x8973ae90b38d8971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d896a expref: 6 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.042250:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8f6a33e00/0x8973ae90b38d8971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d896a expref: 6 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596865.042258:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a33e00, rc 0) 00000100:00100000:1.0:1789596865.042345:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff40f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+6:14359:x1876527964834176:12345-0@lo:101:mount.lustre.0 Request processed in 166us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596865.042352:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789596865.042476:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6571500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964834176:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789596865.042490:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d896a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8971 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.042511:0:14359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d896a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d8971 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596865.042570:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964834304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789596865.042616:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596865.042638:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c905c900 going to sleep for 11 seconds 00000100:00100000:3.0:1789596865.042757:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964834304 00000100:00100000:3.0:1789596865.042761:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964834304 00000100:00100000:3.0:1789596865.042791:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789596865.042798:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff40fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+6:14359:x1876527964834304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596865.043052:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff40fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+6:14359:x1876527964834304:12345-0@lo:501:mount.lustre.0 Request processed in 254us (443us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789596865.043059:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789596865.043421:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964834304:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789596865.043449:0:14359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789596865.043472:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d896a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8971 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.043489:0:14359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d896a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8971 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596865.043507:0:14359:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ea7c29c1800 10000000:01000000:0.0:1789596865.043512:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789596865.043517:0:14359:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ea7c29c1800 10000000:01000000:0.0:1789596865.043519:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789596865.043522:0:14359:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ea7c29c1800 from 1 10000000:01000000:0.0:1789596865.043525:0:14359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789596865.043560:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ff4e7400/0x8973ae90b38d8978 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.043568:0:14359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8ff4e7400/0x8973ae90b38d8978 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.043577:0:14359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8ff4e7400/0x8973ae90b38d8978 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596865.043602:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964834432:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789596865.043717:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596865.043742:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c905c900 going to sleep for 11 seconds 00000100:00100000:2.0:1789596865.043849:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964834432 00000100:00100000:2.0:1789596865.043855:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964834432 00000100:00100000:2.0:1789596865.043882:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789596865.043890:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff40e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+6:14359:x1876527964834432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789596865.043909:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596865.043923:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8ef427600/0x8973ae90b38d897f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d8978 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.043943:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ef427600/0x8973ae90b38d897f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d8978 expref: 7 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.043954:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8ef427600/0x8973ae90b38d897f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8978 expref: 7 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.043962:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427600, rc 0) 00000100:00100000:2.0:1789596865.044007:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff40e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+7:14359:x1876527964834432:12345-0@lo:101:mount.lustre.0 Request processed in 118us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596865.044014:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789596865.044230:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964834432:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789596865.044244:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8ff4e7400/0x8973ae90b38d8978 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d897f expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.044253:0:14359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8ff4e7400/0x8973ae90b38d8978 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d897f expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596865.044277:0:14359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789596865.044282:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ff4e7400/0x8973ae90b38d8978 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d897f expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.044289:0:14359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8ff4e7400/0x8973ae90b38d8978 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d897f expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596865.044295:0:14359:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789596865.044300:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789596865.044305:0:14359:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ea7c29c1800 10000000:01000000:0.0:1789596865.044307:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789596865.044460:0:14359:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789596865.044464:0:14359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789596865.044484:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ff4e6200/0x8973ae90b38d8986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.044493:0:14359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8ff4e6200/0x8973ae90b38d8986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.044751:0:14359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8ff4e6200/0x8973ae90b38d8986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596865.044767:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964834560:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789596865.044802:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596865.044994:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c905c900 going to sleep for 11 seconds 00000100:00100000:2.0:1789596865.045056:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964834560 00000100:00100000:2.0:1789596865.045062:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964834560 00000100:00100000:2.0:1789596865.045143:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789596865.045150:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff40c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+7:14359:x1876527964834560:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789596865.045161:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596865.045171:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8ef427200/0x8973ae90b38d898d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d8986 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.045188:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ef427200/0x8973ae90b38d898d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d8986 expref: 8 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.045197:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8ef427200/0x8973ae90b38d898d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8986 expref: 8 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.045203:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427200, rc 0) 00000100:00100000:2.0:1789596865.045251:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff40c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+8:14359:x1876527964834560:12345-0@lo:101:mount.lustre.0 Request processed in 102us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596865.045257:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789596865.045525:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964834560:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789596865.045539:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8ff4e6200/0x8973ae90b38d8986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d898d expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.045564:0:14359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8ff4e6200/0x8973ae90b38d8986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d898d expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596865.045627:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964834688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789596865.045652:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596865.045674:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c905c900 going to sleep for 11 seconds 00000100:00100000:2.0:1789596865.045730:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964834688 00000100:00100000:2.0:1789596865.045735:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964834688 00000100:00100000:2.0:1789596865.045764:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789596865.045770:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d2e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+8:14359:x1876527964834688:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789596865.046168:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d2e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+9:14359:x1876527964834688:12345-0@lo:501:mount.lustre.0 Request processed in 397us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596865.046175:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789596865.046762:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964834688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789596865.046802:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964834816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789596865.046872:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596865.046905:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c905c900 going to sleep for 11 seconds 00000100:00100000:2.0:1789596865.047002:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964834816 00000100:00100000:2.0:1789596865.047008:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964834816 00000100:00100000:2.0:1789596865.047038:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789596865.047045:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d2e7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+9:14359:x1876527964834816:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789596865.047353:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d2e7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+9:14359:x1876527964834816:12345-0@lo:503:mount.lustre.0 Request processed in 308us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596865.047361:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789596865.047597:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964834816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789596865.048242:0:14395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14395:1876527964834944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596865.048293:0:14395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596865.048399:0:14395:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c905c240 going to sleep for 11 seconds 00000100:00100000:2.0:1789596865.048447:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964834944 00000100:00100000:2.0:1789596865.048453:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964834944 00000100:00100000:2.0:1789596865.048489:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789596865.048497:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d2e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+9:14395:x1876527964834944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596865.049031:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d2e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+9:14395:x1876527964834944:12345-0@lo:502:llog_process_th.0 Request processed in 534us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596865.049039:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789596865.049253:0:14395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14395:1876527964834944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789596865.049278:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596865.049288:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596865.049291:0:14395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789596865.049296:0:14395:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789596865.049299:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789596865.049378:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9ea8c3403380) 00000020:00000080:0.0:1789596865.049396:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789596865.049402:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789596865.049474:0:14395:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789596865.049479:0:14395:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8973ae90b38d899b 00000020:00000080:0.0:1789596865.049771:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789596865.049775:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596865.049778:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596865.049780:0:14395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789596865.049782:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596865.049786:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596865.049787:0:14395:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789596865.049790:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789596865.049797:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9ea8c34019c0) 00000020:00000080:0.0:1789596865.049806:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789596865.049808:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789596865.049810:0:14395:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789596865.049813:0:14395:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789596865.050045:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789596865.050082:0:14395:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ea7c29c1800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789596865.050094:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9ea8c2ca3380) 00000020:00000080:0.0:1789596865.050101:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789596865.050147:0:14395:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789596865.050153:0:14395:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8973ae90b38d89b0 00000020:00000080:0.0:1789596865.050239:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789596865.050244:0:14395:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789596865.050247:0:14395:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8973ae90b38d89b7 00080000:01000000:0.0:1789596865.050252:0:14395:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789596865.050254:0:14395:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8973ae90b38d89be 00010000:00010000:3.0:1789596865.137931:0:14395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789596865.138751:0:14395:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1789596865.139167:0:14395:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789596865.140531:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ea8f66f4d40) 00000020:00000080:3.0:1789596865.140564:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789596865.140864:0:14395:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789596865.140871:0:14395:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8973ae90b38d89cc 00000020:00000080:0.0:1789596865.144587:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789596865.153282:0:14395:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8973ae90b38d89d3 00000020:00000080:3.0:1789596865.156564:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789596865.156589:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596865.156601:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596865.156610:0:14395:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789596865.156615:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596865.156621:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596865.156623:0:14395:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789596865.156627:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789596865.156676:0:14395:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789596865.156712:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596865.156715:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596865.157028:0:14395:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789596865.157034:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789596865.157036:0:14395:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:3.0:1789596865.157038:0:14395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789596865.157039:0:14395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789596865.157041:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789596865.157044:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596865.157046:0:14395:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789596865.157048:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789596865.157053:0:14395:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789596865.157056:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596865.157057:0:14395:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789596865.157060:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789596865.157065:0:14395:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.144@tcp to nid 0x20000c0a8ca90 (192.168.202.144@tcp) 00000020:01000000:3.0:1789596865.157094:0:14395:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789596865.157097:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789596865.157112:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ea8f66f3380) 00000020:00000080:3.0:1789596865.157130:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789596865.157134:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789596865.157206:0:14395:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789596865.157213:0:14395:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789596865.157222:0:14395:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8973ae90b38d89e1 00010000:00080000:3.0:1789596865.157255:0:14395:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ea8f7460000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.144@tcp at head 00010000:00010000:3.0:1789596865.157794:0:14395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1789596865.159954:0:14395:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789596865.160028:0:14395:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789596865.168668:0:14395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789596865.168764:0:14395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789596865.169424:0:14395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789596865.170184:0:14399:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789596865.170198:0:14399:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789596865.171494:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789596865.171757:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789596865.171795:0:14395:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789596865.171813:0:14395:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8973ae90b38d89e8 00000100:00080000:1.0:1789596865.172012:0:14395:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789596865.172023:0:14395:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ea8f7460000 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:1.0:1789596865.172056:0:14395:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ea8fa65b800 x1876527964835072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789596865.172119:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964835072:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789596865.172184:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527964835072 offset 0 length 520: 4 00000100:00080000:1.0:1789596865.172259:0:14395:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789596865.172335:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596865.172340:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596865.172342:0:14395:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789596865.172345:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789596865.172347:0:14395:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1789596865.172349:0:14395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789596865.172351:0:14395:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789596865.172352:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789596865.172362:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596865.172363:0:14395:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789596865.172367:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789596865.172372:0:14395:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789596865.172375:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596865.172377:0:14395:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789596865.172380:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789596865.172384:0:14395:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.144@tcp to nid 0x20000c0a8ca90 (192.168.202.144@tcp) 00000020:01000000:1.0:1789596865.172404:0:14395:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789596865.172406:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789596865.172418:0:14395:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ea8c6e219c0) 00000020:00000080:1.0:1789596865.172429:0:14395:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789596865.172434:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789596865.172513:0:14395:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789596865.172521:0:14395:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789596865.172527:0:14395:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8973ae90b38d89f6 00010000:00080000:1.0:1789596865.172565:0:14395:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ea8c86d0800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.144@tcp at head 00010000:00010000:1.0:1789596865.173148:0:14395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789596865.173345:0:14395:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789596865.173769:0:14395:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789596865.178760:0:14395:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789596865.179031:0:14395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789596865.179106:0:14395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789596865.180089:0:14401:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789596865.180096:0:14401:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789596865.181439:0:14395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789596865.181453:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789596865.181489:0:14395:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789596865.181518:0:14395:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8973ae90b38d89fd 00000100:00080000:0.0:1789596865.181529:0:14395:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789596865.181548:0:14395:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ea8c86d0800 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:0.0:1789596865.181602:0:14395:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ea8c6ec1180 x1876527964835200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789596865.182013:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964835200:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789596865.182065:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527964835200 offset 0 length 520: 4 00000100:00080000:0.0:1789596865.182119:0:14395:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789596865.182170:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596865.182174:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596865.182176:0:14395:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789596865.182179:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596865.182183:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596865.182184:0:14395:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789596865.182187:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789596865.182189:0:14395:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789596865.182191:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596865.182193:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596865.182194:0:14395:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789596865.182197:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596865.182199:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596865.182201:0:14395:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789596865.182204:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789596865.182234:0:14395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14395:1876527964835328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596865.182283:0:14395:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596865.182297:0:14395:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c51b79c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596865.182627:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964835328 00000100:00100000:1.0:1789596865.182635:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964835328 00000100:00100000:1.0:1789596865.182680:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789596865.182688:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+9:14395:x1876527964835328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596865.182969:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+9:14395:x1876527964835328:12345-0@lo:502:llog_process_th.0 Request processed in 279us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596865.182977:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789596865.183663:0:14395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14395:1876527964835328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789596865.183697:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596865.183703:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596865.183705:0:14395:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789596865.183711:0:14395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789596865.184292:0:14359:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1789596865.184669:0:14359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789596865.184727:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ff4e6200/0x8973ae90b38d8986 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d898d expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.184741:0:14359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8ff4e6200/0x8973ae90b38d8986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d898d expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596865.184750:0:14359:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ea7c29c1800 from 1 10000000:01000000:2.0:1789596865.184753:0:14359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789596865.184788:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d8a04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.184797:0:14359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d8a04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.184808:0:14359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d8a04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596865.184862:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964835456:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789596865.184921:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596865.184958:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6137780 going to sleep for 11 seconds 00000100:00100000:0.0:1789596865.185133:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964835456 00000100:00100000:0.0:1789596865.185142:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964835456 00000100:00100000:0.0:1789596865.185181:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789596865.185191:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+9:14359:x1876527964835456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789596865.185221:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596865.185238:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8ff4e6800/0x8973ae90b38d8a0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d8a04 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.185263:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ff4e6800/0x8973ae90b38d8a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d8a04 expref: 10 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.185275:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8ff4e6800/0x8973ae90b38d8a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8a04 expref: 10 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.185283:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ff4e6800, rc 0) 00000100:00100000:0.0:1789596865.185400:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+10:14359:x1876527964835456:12345-0@lo:101:mount.lustre.0 Request processed in 211us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596865.185407:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789596865.186078:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964835456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789596865.186097:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d8a04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a0b expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.186108:0:14359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d8a04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d8a0b expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596865.188098:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964835584:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789596865.188183:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596865.188276:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6137780 going to sleep for 11 seconds 00000100:00100000:0.0:1789596865.188460:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964835584 00000100:00100000:0.0:1789596865.188469:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964835584 00000100:00100000:0.0:1789596865.188768:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789596865.188779:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+10:14359:x1876527964835584:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789596865.188801:0:14371:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789596865.188806:0:14371:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789596865.188942:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+10:14359:x1876527964835584:12345-0@lo:256:mount.lustre.0 Request processed in 165us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596865.188950:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789596865.189061:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964835584:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789596865.189699:0:14359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789596865.189730:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d8a04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a0b expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.189742:0:14359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d8a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a0b expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596865.189750:0:14359:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea7c29c1800 from 1 10000000:01000000:2.0:1789596865.189753:0:14359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789596865.189784:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.189793:0:14359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.189802:0:14359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596865.189841:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964835712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789596865.189878:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596865.190942:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6137780 going to sleep for 11 seconds 00000100:00100000:3.0:1789596865.191083:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964835712 00000100:00100000:3.0:1789596865.191091:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964835712 00000100:00100000:3.0:1789596865.191136:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789596865.191145:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+10:14359:x1876527964835712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789596865.191158:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596865.191178:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d8a19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d8a12 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.191201:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d8a19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d8a12 expref: 11 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.191213:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d8a19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8a12 expref: 11 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.191222:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88400, rc 0) 00000100:00100000:3.0:1789596865.191275:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+11:14359:x1876527964835712:12345-0@lo:101:mount.lustre.0 Request processed in 131us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596865.191281:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789596865.191470:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964835712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789596865.191554:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a19 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.191564:0:14359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d8a19 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596865.191642:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964835840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789596865.191671:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596865.191681:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6137780 going to sleep for 11 seconds 00000100:00100000:3.0:1789596865.191947:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964835840 00000100:00100000:3.0:1789596865.191952:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964835840 00000100:00100000:3.0:1789596865.191973:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789596865.191980:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+11:14359:x1876527964835840:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596865.192495:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+11:14359:x1876527964835840:12345-0@lo:501:mount.lustre.0 Request processed in 513us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596865.192685:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789596865.192995:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964835840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789596865.193036:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964835968:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789596865.193081:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596865.193115:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6137780 going to sleep for 11 seconds 00000100:00100000:3.0:1789596865.193168:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964835968 00000100:00100000:3.0:1789596865.193174:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964835968 00000100:00100000:3.0:1789596865.193216:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789596865.193223:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+11:14359:x1876527964835968:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789596865.193762:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+11:14359:x1876527964835968:12345-0@lo:503:mount.lustre.0 Request processed in 538us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596865.193770:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789596865.193992:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964835968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789596865.195446:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14403:1876527964836096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596865.195726:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596865.195924:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c51b7900 going to sleep for 11 seconds 00000100:00100000:2.0:1789596865.196086:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964836096 00000100:00100000:2.0:1789596865.196094:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964836096 00000100:00100000:2.0:1789596865.196171:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789596865.196179:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+11:14403:x1876527964836096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596865.196799:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+11:14403:x1876527964836096:12345-0@lo:502:llog_process_th.0 Request processed in 616us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596865.196809:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789596865.197063:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14403:1876527964836096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789596865.197098:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596865.197108:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596865.197111:0:14403:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789596865.197119:0:14403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ea7c29c1800 00000020:00000080:0.0:1789596865.197122:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789596865.197129:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596865.197131:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596865.197132:0:14403:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789596865.197134:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596865.197137:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596865.197138:0:14403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789596865.197141:0:14403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ea7c29c1800 00000020:00000080:0.0:1789596865.197143:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789596865.197205:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596865.197209:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596865.197210:0:14403:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789596865.197213:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789596865.197215:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596865.197216:0:14403:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789596865.197220:0:14403:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ea7c29c1800 00000020:00000080:0.0:1789596865.197222:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789596865.197269:0:14403:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14403:1876527964836224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596865.197319:0:14403:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596865.204513:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964836224 00000100:00100000:3.0:1789596865.204530:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964836224 00000100:00100000:3.0:1789596865.204807:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789596865.204848:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+11:14403:x1876527964836224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789596865.205115:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+11:14403:x1876527964836224:12345-0@lo:502:llog_process_th.0 Request processed in 298us (7808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596865.205124:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789596865.208051:0:14403:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c51b7900 going to sleep for 11 seconds 00000100:00100000:0.0:1789596865.208095:0:14403:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14403:1876527964836224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789596865.208133:0:14403:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789596865.208140:0:14403:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789596865.208142:0:14403:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789596865.208148:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789596865.208585:0:14359:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789596865.208735:0:14359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789596865.208753:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a19 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.208765:0:14359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a19 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596865.208904:0:14359:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789596865.208908:0:14359:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ea7c29c1800 10000000:01000000:3.0:1789596865.208911:0:14359:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ea7c29c1800 10000000:01000000:3.0:1789596865.208916:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789596865.208921:0:14359:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ea7c29c1800 from 1 10000000:01000000:3.0:1789596865.208924:0:14359:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789596865.208958:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89000/0x8973ae90b38d8a20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.208979:0:14359:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89000/0x8973ae90b38d8a20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.208990:0:14359:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89000/0x8973ae90b38d8a20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596865.209010:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964836352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789596865.209071:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596865.209098:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c56d3600 going to sleep for 11 seconds 00000100:00100000:3.0:1789596865.209125:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964836352 00000100:00100000:3.0:1789596865.209131:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964836352 00000100:00100000:3.0:1789596865.209180:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789596865.209190:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+11:14359:x1876527964836352:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789596865.209204:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596865.209217:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d8a27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d8a20 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.209239:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d8a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d8a20 expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.209249:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f88600/0x8973ae90b38d8a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8a20 expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.209257:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88600, rc 0) 00000100:00100000:3.0:1789596865.209295:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:14359:x1876527964836352:12345-0@lo:101:mount.lustre.0 Request processed in 107us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596865.209301:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789596865.212764:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964836352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789596865.212796:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89000/0x8973ae90b38d8a20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a27 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.212811:0:14359:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89000/0x8973ae90b38d8a20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d8a27 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596865.213113:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964836480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596865.213169:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596865.213220:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c56d3600 going to sleep for 11 seconds 00000100:00100000:1.0:1789596865.213996:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964836480 00000100:00100000:1.0:1789596865.214006:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964836480 00000100:00100000:1.0:1789596865.214057:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789596865.214067:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:14359:x1876527964836480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789596865.216733:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:14359:x1876527964836480:12345-0@lo:501:mount.lustre.0 Request processed in 2658us (3554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596865.216749:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789596865.218049:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964836480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596865.218109:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964836608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789596865.218175:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596865.218212:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c56d3600 going to sleep for 11 seconds 00000100:00100000:3.0:1789596865.218234:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964836608 00000100:00100000:3.0:1789596865.218241:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964836608 00000100:00100000:3.0:1789596865.218288:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789596865.218297:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:14359:x1876527964836608:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789596865.219113:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:14359:x1876527964836608:12345-0@lo:503:mount.lustre.0 Request processed in 813us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596865.219123:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789596865.219184:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964836608:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789596865.230059:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14407:1876527964836736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596865.230139:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596865.230182:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964836736 00000100:00100000:1.0:1789596865.230189:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964836736 00000100:00100000:1.0:1789596865.231965:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789596865.231983:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:14407:x1876527964836736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789596865.232280:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:14407:x1876527964836736:12345-0@lo:502:llog_process_th.0 Request processed in 301us (2139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596865.232289:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789596865.236519:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c57420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596865.236576:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14407:1876527964836736:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789596865.236895:0:14407:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789596865.236913:0:14407:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ea8c2ca19c0) 00000020:00000080:0.0:1789596865.236932:0:14407:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1789596865.237028:0:14407:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ea7c29c1800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789596865.237033:0:14407:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ea7c29c1800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789596865.237036:0:14407:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ea7c29c1800 4 00010000:00080000:0.0:1789596865.237065:0:14407:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ea8eaf05800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.144@tcp at head 00010000:00010000:0.0:1789596865.244425:0:14407:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1789596865.244635:0:14407:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789596865.244674:0:14407:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789596865.244688:0:14407:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8973ae90b38d8a35 00000100:00080000:0.0:1789596865.244698:0:14407:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789596865.244710:0:14407:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ea8eaf05800 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:0.0:1789596865.244746:0:14407:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ea8c6ec0a80 x1876527964836864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789596865.244767:0:14407:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789596865.246937:0:14407:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14407:1876527964836992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789596865.247014:0:14407:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596865.247055:0:14407:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c51b7900 going to sleep for 11 seconds 00000100:00100000:2.0:1789596865.247102:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876527964836864:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789596865.247144:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596865.247219:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964836992 00000100:00100000:2.0:1789596865.247226:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964836992 00000100:00100000:2.0:1789596865.247276:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789596865.247285:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:14407:x1876527964836992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789596865.247752:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:14407:x1876527964836992:12345-0@lo:502:llog_process_th.0 Request processed in 467us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596865.247761:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789596865.253724:0:14407:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14407:1876527964836992:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789596865.253775:0:14407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:0.0:1789596865.254515:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964836864 00000100:00100000:0.0:1789596865.254525:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964836864 00000100:00100000:0.0:1789596865.254588:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789596865.254597:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876527964836864:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789596865.254703:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876527964836864:12345-0@lo:38:llog_process_th.0 Request processed in 106us (7558us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789596865.254710:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789596865.254746:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789596865.254764:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8eaf05800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789596865.254768:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789596865.254772:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876527964836864:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1789596865.261054:0:14359:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789596865.261088:0:14359:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789596865.261475:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89000/0x8973ae90b38d8a20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a27 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596865.261502:0:14359:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89000/0x8973ae90b38d8a20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a27 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789596865.261635:0:14359:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789596865.261638:0:14359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789596865.261639:0:14359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596865.261640:0:14359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596865.261642:0:14359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596865.261643:0:14359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596865.261644:0:14359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789596865.261646:0:14359:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789596865.261648:0:14359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596865.261649:0:14359:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789596865.261653:0:14359:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789596865.261656:0:14359:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789596865.261658:0:14359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789596865.261659:0:14359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596865.261660:0:14359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596865.261661:0:14359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596865.261662:0:14359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596865.261663:0:14359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789596865.261664:0:14359:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789596865.261665:0:14359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596865.261667:0:14359:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789596865.261694:0:14359:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789596865.261715:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964837120:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789596865.261782:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596865.261986:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964837120 00000100:00100000:2.0:1789596865.261993:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964837120 00000100:00100000:2.0:1789596865.262041:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789596865.262050:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:14359:x1876527964837120:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789596865.262076:0:14371:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789596865.262091:0:14371:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789596865.262662:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c56d3000 going to sleep for 11 seconds 20000000:01000000:0.0:1789596865.306082:0:14371:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789596865.306105:0:14371:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789596865.306852:0:14393:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789596865.306858:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789596865.306881:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8a3c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.306899:0:14393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8ff4e6800/0x8973ae90b38d8a0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8a04 expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.306906:0:14393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8a3c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.306947:0:14393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8ff4e6800/0x8973ae90b38d8a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d8a04 expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.306962:0:14393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ea8ff4e6800/0x8973ae90b38d8a0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d8a04 expref: 12 pid: 14372 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596865.306995:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6573800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1876527964837248:0@lo:104: 00000100:00100000:2.0:1789596865.307060:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596865.307108:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea7c2c93300 going to sleep for 11 seconds 00000100:00100000:0.0:1789596865.307192:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964837248 00000100:00100000:0.0:1789596865.307200:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964837248 00000100:00100000:0.0:1789596865.307254:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789596865.307263:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6571180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+3:14393:x1876527964837248:12345-0@lo:104: 00010000:00010000:0.0:1789596865.307276:0:14360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d8a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d8a0b expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.307344:0:14360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789596865.307350:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6571180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+3:14393:x1876527964837248:12345-0@lo:104: Request processed in 89us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596865.307356:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789596865.307392:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6573800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1876527964837248:0@lo:104: 00010000:00010000:0.0:1789596865.307410:0:14393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8a3c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.307873:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596865.307880:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d8a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d8a0b expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.307888:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426200 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596865.307892:0:14366:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d8a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d8a0b expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.307901:0:14366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d8a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d8a0b expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596865.307909:0:14366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d8a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d8a0b expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596865.307915:0:14366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596865.307949:0:14366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d8a04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8a0b expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.307956:0:14366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596865.307977:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d8a04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8a0b expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.307983:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426200/0x8973ae90b38d8a04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8a0b expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.307998:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596865.308008:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596865.308010:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596865.308034:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789596865.308044:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3309:1876527964837376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596865.308080:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596865.308130:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964837376 00000100:00100000:2.0:1789596865.308135:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964837376 00010000:00010000:2.0:1789596865.308154:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8ff4e6800/0x8973ae90b38d8a0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d8a04 expref: 13 pid: 14372 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596865.308176:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789596865.308184:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6570700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+13:3309:x1876527964837376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596865.308195:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596865.308199:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8ff4e6800/0x8973ae90b38d8a0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d8a04 expref: 13 pid: 14372 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.308209:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8ff4e6800/0x8973ae90b38d8a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d8a04 expref: 13 pid: 14372 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.308222:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8ff4e6800/0x8973ae90b38d8a0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d8a04 expref: 13 pid: 14372 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.308235:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8a3c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.308244:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8a3c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789596865.308258:0:14362:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001399842s 00010000:00010000:2.0:1789596865.308262:0:14362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8a3c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.308281:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8a3c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.308288:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8a3c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.308295:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8a3c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.308302:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427c00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596865.308386:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8a3c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.308394:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8a3c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.308405:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8a3c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596865.308415:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596865.308449:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6570700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:3309:x1876527964837376:12345-0@lo:103:ldlm_bl.0 Request processed in 266us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596865.308456:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789596865.308486:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3309:1876527964837376:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789596865.308703:0:14393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8a3c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.308712:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8a3c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596865.308718:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8a3c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596865.323691:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+11:14359:x1876527964837120:12345-0@lo:253:mount.lustre.0 Request processed in 61634us (61900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596865.323705:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789596865.323786:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14359:1876527964837120:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789596865.323800:0:14359:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789596865.323803:0:14359:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789596865.323805:0:14359:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789596865.323807:0:14359:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596865.323907:0:14359:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596865.323909:0:14359:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596865.323910:0:14359:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596865.323911:0:14359:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789596865.323913:0:14359:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789596865.323915:0:14359:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596865.323916:0:14359:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789596865.323932:0:14359:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789596865.329410:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789596865.329679:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789596865.329996:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789596865.330155:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789596865.330430:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789596865.331287:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789596865.332136:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789596865.332293:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789596865.332853:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789596865.333075:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789596865.334058:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789596865.334719:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1789596865.362465:0:14359:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1789596865.363074:0:14359:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789596865.363212:0:14413:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1789596865.363216:0:14413:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1789596865.364076:0:14415:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789596865.364162:0:14415:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789596865.367212:0:14415:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789596865.367295:0:14415:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789596865.367300:0:14415:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1789596865.370433:0:14359:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789596865.370730:0:14359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789596865.371729:0:14359:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789596865.371744:0:14359:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789596865.372064:0:14359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789596865.373301:0:14359:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789596865.374109:0:14359:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789596865.374146:0:14359:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789596865.375043:0:14359:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1789596865.377699:0:14359:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1789596865.383234:0:14359:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789596865.426111:0:14359:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789596865.426143:0:14359:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc02841c7f988 00100000:10000000:2.0:1789596865.426150:0:14359:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789596865.426775:0:14359:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789596865.426791:0:14359:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.144@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789596865.426806:0:14359:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789596865.426881:0:14359:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1789596865.883174:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789596866.268050:0:14409:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789596866.268061:0:14409:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789596866.268690:0:14409:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:3.0:1789596866.268700:0:14409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:1.0:1789596866.588271:0:14374:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789596866.588279:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ea7c29c1800 from 6 10000000:01000000:1.0:1789596866.588284:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789596866.588353:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33a00/0x8973ae90b38d8a43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596866.588387:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33a00/0x8973ae90b38d8a43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596866.588399:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33a00/0x8973ae90b38d8a43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596866.588424:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa659500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964837504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789596866.588493:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596866.588546:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d35483c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596866.588972:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964837504 00000100:00100000:2.0:1789596866.588982:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964837504 00000100:00100000:2.0:1789596866.589041:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789596866.589052:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+11:14374:x1876527964837504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596866.589065:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596866.589080:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8a4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d8a43 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596866.589105:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d8a43 expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596866.589116:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8a43 expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596866.589125:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427800, rc 0) 00000100:00100000:2.0:1789596866.589179:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:14374:x1876527964837504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596866.589186:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789596866.589270:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa659500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964837504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596866.589284:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33a00/0x8973ae90b38d8a43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a4a expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596866.589303:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33a00/0x8973ae90b38d8a43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d8a4a expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596866.589358:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964837632:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789596866.589391:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596866.589431:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c51b73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596866.589488:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964837632 00000100:00100000:0.0:1789596866.589493:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964837632 00000100:00100000:0.0:1789596866.589527:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789596866.589535:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:14374:x1876527964837632:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789596866.589549:0:14371:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789596866.589574:0:14371:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789596866.589578:0:14371:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789596866.589658:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:14374:x1876527964837632:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596866.589665:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789596866.589739:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964837632:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789596866.589784:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789596866.589791:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33a00/0x8973ae90b38d8a43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a4a expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596866.589800:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33a00/0x8973ae90b38d8a43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a4a expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596866.907368:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789596867.310696:0:14409:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789596867.311053:0:14409:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789596867.311598:0:14409:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789596867.311675:0:14409:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789596867.312146:0:14409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:1.0:1789596867.931812:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596868.955009:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596869.981573:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789596870.183749:0:14658:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg244-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1789596870.684973:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789596870.684980:0:470:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789596870.684983:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789596870.684986:0:470:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789596870.685006:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789596870.685010:0:470:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789596870.685014:0:470:0:(import.c:65:import_set_state_nolock()) ffff9ea8eaf05800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789596870.685031:0:470:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ea8eaf05800 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:1.0:1789596870.685055:0:470:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ea8fa65b100 x1876527964837888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789596870.685095:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3309:1876527964837760:0@lo:400:kworker.0 00000100:00100000:1.0:1789596870.685166:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596870.685448:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964837760 00000100:00100000:0.0:1789596870.685457:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964837760 00000100:00100000:0.0:1789596870.685514:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789596870.685523:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:3309:x1876527964837760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596870.685602:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:3309:x1876527964837760:12345-0@lo:400:kworker.0 Request processed in 68us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596870.685609:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789596870.685663:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3309:1876527964837760:0@lo:400:kworker.0 00000100:00100000:0.0:1789596870.685706:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876527964837888:0@lo:38:kworker.0 00000100:00100000:0.0:1789596870.685735:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596870.686612:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964837888 00000100:00100000:2.0:1789596870.686620:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964837888 00000100:00100000:2.0:1789596870.686658:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789596870.686664:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876527964837888:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789596870.686689:0:14379:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:2.0:1789596870.686722:0:14379:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8973ae90b38d8a51 00000004:00100000:2.0:1789596870.686738:0:14379:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789596870.687619:0:14379:0:(import.c:65:import_set_state_nolock()) ffff9ea8c9031800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789596870.688514:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876527964837888:12345-0@lo:38:kworker.0 Request processed in 1843us (2772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596870.688526:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789596870.688604:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ea8fa65b100 x1876527964837888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789596880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789596870.688623:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789596870.688632:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789596870.688637:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789596870.688640:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8eaf05800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789596870.688646:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876527964837888:0@lo:38:kworker.0 00010000:00010000:0.0:1789596871.007648:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596872.028983:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596873.054593:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789596873.704239:0:14810:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb41e2600 20000000:00000080:1.0:1789596873.704267:0:14810:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ea8fb171400 uarg=0000000000000000 20000000:01000000:1.0:1789596873.704313:0:14810:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789596873.704323:0:14810:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789596873.704329:0:14810:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789596873.709156:0:14811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1789596873.709376:0:14810:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789596873.718402:0:14810:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789596873.718805:0:14810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ea8ff4e6600/0x8973ae90b38d8a58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596873.718956:0:14810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d8a19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8a12 expref: 11 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596873.718967:0:14810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ea8ff4e6600/0x8973ae90b38d8a58 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596873.719025:0:14810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d8a19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d8a12 expref: 11 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596873.719044:0:14810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d8a19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d8a12 expref: 11 pid: 14372 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596873.719084:0:14810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14810:1876527964838016:0@lo:104: 00000100:00100000:0.0:1789596873.719172:0:14810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596873.719291:0:14810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff4b0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596873.720043:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964838016 00000100:00100000:2.0:1789596873.720055:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964838016 00000100:00100000:2.0:1789596873.720152:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789596873.720164:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+3:14810:x1876527964838016:12345-0@lo:104: 00010000:00010000:2.0:1789596873.720181:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d8a19 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.720285:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789596873.720291:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+3:14810:x1876527964838016:12345-0@lo:104: Request processed in 130us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596873.720312:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789596873.720522:0:14810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14810:1876527964838016:0@lo:104: 00010000:00010000:1.0:1789596873.720556:0:14810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ea8ff4e6600/0x8973ae90b38d8a58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.722311:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596873.722329:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d8a19 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.722342:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426600 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596873.722347:0:14365:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d8a19 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.722358:0:14365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d8a19 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596873.722367:0:14365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d8a19 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596873.722374:0:14365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789596873.722557:0:14365:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8a19 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.722565:0:14365:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596873.722605:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a12 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8a19 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.722613:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8a19 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.722633:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596873.722854:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3306:1876527964838144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789596873.722958:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789596873.723344:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596873.723348:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596873.723365:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964838144 00000100:00100000:2.0:1789596873.723390:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964838144 00010000:00010000:2.0:1789596873.723425:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d8a19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d8a12 expref: 12 pid: 14372 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596873.723468:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789596873.723478:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa658380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:3306:x1876527964838144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596873.723713:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596873.723734:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d8a19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d8a12 expref: 12 pid: 14372 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.723756:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d8a19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d8a12 expref: 12 pid: 14372 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.723775:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f88400/0x8973ae90b38d8a19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d8a12 expref: 12 pid: 14372 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.723796:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ea8ff4e6600/0x8973ae90b38d8a58 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.723804:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ff4e6600/0x8973ae90b38d8a58 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.723870:0:14362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8ff4e6600/0x8973ae90b38d8a58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.723879:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8ff4e6600/0x8973ae90b38d8a58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.723886:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ea8ff4e6600/0x8973ae90b38d8a58 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.723892:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ea8ff4e6600/0x8973ae90b38d8a58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.723913:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6600 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596873.723917:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ea8ff4e6600/0x8973ae90b38d8a58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.723930:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ea8ff4e6600/0x8973ae90b38d8a58 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.723948:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ea8ff4e6600/0x8973ae90b38d8a58 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596873.723962:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596873.724053:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa658380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+11:3306:x1876527964838144:12345-0@lo:103:ldlm_bl.0 Request processed in 576us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596873.724063:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789596873.724127:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3306:1876527964838144:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789596873.724304:0:14810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ea8ff4e6600/0x8973ae90b38d8a58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596873.724317:0:14810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ea8ff4e6600/0x8973ae90b38d8a58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596873.724324:0:14810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8ff4e6600/0x8973ae90b38d8a58 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596874.076845:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789596875.105534:0:14374:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789596875.105542:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea7c29c1800 from 10 10000000:01000000:2.0:1789596875.105548:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789596875.105592:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8a5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596875.105604:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8a5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596875.105796:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596875.106053:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8a5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596875.106080:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964838272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789596875.106509:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596875.106566:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c61a3480 going to sleep for 11 seconds 00000100:00100000:1.0:1789596875.106800:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964838272 00000100:00100000:1.0:1789596875.106809:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964838272 00000100:00100000:1.0:1789596875.108255:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789596875.108268:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+11:14374:x1876527964838272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596875.108286:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596875.108306:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8f6a32400/0x8973ae90b38d8a66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d8a5f expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596875.108341:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8f6a32400/0x8973ae90b38d8a66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d8a5f expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596875.108354:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8f6a32400/0x8973ae90b38d8a66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8a5f expref: 12 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596875.108364:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32400, rc 0) 00000100:00100000:1.0:1789596875.108431:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:14374:x1876527964838272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (1925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596875.108439:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789596875.108633:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964838272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596875.108652:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8a5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a66 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596875.108662:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8a5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d8a66 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596875.108732:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964838400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596875.108765:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596875.108810:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c61a3480 going to sleep for 11 seconds 00000100:00100000:0.0:1789596875.108863:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964838400 00000100:00100000:0.0:1789596875.108869:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964838400 00000100:00100000:0.0:1789596875.108899:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789596875.108907:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:14374:x1876527964838400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596875.109315:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:14374:x1876527964838400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 407us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596875.109323:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789596875.111102:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964838400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596875.111242:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964838528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596875.111305:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596875.111348:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c61a3480 going to sleep for 11 seconds 00000100:00100000:0.0:1789596875.111529:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964838528 00000100:00100000:0.0:1789596875.111536:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964838528 00000100:00100000:0.0:1789596875.111587:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789596875.111596:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:14374:x1876527964838528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596875.116066:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:14374:x1876527964838528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4451us (4741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596875.116085:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789596875.116371:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964838528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789596875.120561:0:14847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789596875.120939:0:14374:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789596875.120964:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789596875.120976:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8a5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a66 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596875.120988:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8a5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a66 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596875.803273:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596865/real 1789596865] req@ffff9ea8c6ec1180 x1876527964835200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596875 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596875.803392:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ea8c6ec1180 x1876527964835200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596875 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596875.803653:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596865/real 1789596865] req@ffff9ea8fa65b800 x1876527964835072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596875 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596875.803762:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ea8fa65b800 x1876527964835072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596875 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789596875.803790:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8c86d0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789596875.803812:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789596875.803875:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964835200:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789596875.803893:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8f7460000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789596875.803914:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789596875.803923:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964835072:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789596875.804873:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789596875.804884:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789596875.804904:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ea8f7460000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789596875.804913:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:2.0:1789596875.804920:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789596875.804935:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ea8f7460000 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:2.0:1789596875.804982:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ea8f6571f80 x1876527964838656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789596875.805004:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789596875.805007:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789596875.805009:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ea8c86d0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789596875.805012:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:2.0:1789596875.805014:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789596875.805019:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ea8c86d0800 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:2.0:1789596875.805027:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ea8f6570e00 x1876527964838784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789596875.805100:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876527964838912:0@lo:400:kworker.0 00000100:00100000:2.0:1789596875.805201:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596875.805335:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964838912 00000100:00100000:2.0:1789596875.805347:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964838912 00000100:00100000:0.0:1789596875.805354:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964838656:0@lo:8:kworker.0 00000100:00100000:2.0:1789596875.805416:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000400:00000100:0.0:1789596875.805418:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527964838656 offset 0 length 520: 4 00000100:00100000:2.0:1789596875.805433:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876527964838912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596875.805562:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876527964838912:12345-0@lo:400:kworker.0 Request processed in 134us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596875.805570:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789596875.805639:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ea8f6572d80 x1876527964838912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596875.806990:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964838784:0@lo:8:kworker.0 00000400:00000100:0.0:1789596875.807048:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876527964838784 offset 0 length 520: 4 00000100:00100000:2.0:1789596875.809317:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876527964838912:0@lo:400:kworker.0 00010000:00010000:2.0:1789596876.123109:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596877.150075:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789596877.535167:0:14409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789596878.172529:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596879.198519:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789596880.211705:0:15059:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789596880.211710:0:15059:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789596880.211883:0:15059:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ea8ff34e000 00000020:01000004:3.0:1789596880.211899:0:15059:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789596880.211910:0:15059:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789596880.211923:0:15059:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ea8f66f19c0) 00000020:00000080:3.0:1789596880.211943:0:15059:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00010000:00010000:1.0:1789596880.224922:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789596880.250278:0:15059:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789596880.250605:0:15059:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789596880.252499:0:15059:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789596880.252728:0:15059:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789596880.253359:0:15059:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789596880.254262:0:15059:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 251: rc = 0 00100000:10000000:2.0:1789596880.254416:0:15059:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 251: rc = 0 00100000:10000000:2.0:1789596880.254520:0:15059:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 251: rc = 0 00100000:10000000:2.0:1789596880.257418:0:15059:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 897: rc = 0 00100000:10000000:2.0:1789596880.258127:0:15059:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 897: rc = 0 00100000:10000000:2.0:1789596880.258561:0:15059:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 897: rc = 0 00100000:10000000:2.0:1789596880.259009:0:15059:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 897: rc = 0 00100000:10000000:2.0:1789596880.259542:0:15059:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 897: rc = 0 00100000:10000000:2.0:1789596880.260386:0:15059:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 897: rc = 0 00000020:00000080:2.0:1789596880.263986:0:15059:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789596880.263999:0:15059:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789596880.264011:0:15059:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8973ae90b38d8a74 00000020:01000004:2.0:1789596880.264018:0:15059:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789596880.264039:0:15059:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.144@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789596880.264042:0:15059:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789596880.264049:0:15059:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789596880.264053:0:15059:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789596880.264065:0:15059:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ea8ffa819c0) 00000020:00000080:2.0:1789596880.264283:0:15059:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1789596880.276688:0:15059:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789596880.277669:0:15059:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789596880.277677:0:15059:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789596880.281285:0:15059:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789596880.281300:0:15059:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789596880.282197:0:15059:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789596880.282207:0:15059:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789596880.284997:0:15059:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789596880.285731:0:15059:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789596880.285747:0:15059:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789596880.291639:0:15059:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789596880.291655:0:15059:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789596880.329637:0:15059:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789596880.330515:0:15059:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789596880.330523:0:15059:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789596880.332573:0:15059:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789596880.332590:0:15059:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789596880.337313:0:15059:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789596880.337335:0:15059:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789596880.340226:0:15059:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789596880.340498:0:15059:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789596880.340506:0:15059:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789596880.341629:0:15059:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789596880.341642:0:15059:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789596880.428316:0:15059:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789596880.428623:0:15059:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789596880.428631:0:15059:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789596880.435094:0:15059:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789596880.435112:0:15059:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789596880.435545:0:15059:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789596880.435568:0:15059:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789596880.435574:0:15059:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.144@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789596880.450420:0:15059:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.144@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789596880.450477:0:15059:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.144@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789596880.450482:0:15059:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789596880.450484:0:15059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789596880.450486:0:15059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789596880.450487:0:15059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789596880.450489:0:15059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789596880.450496:0:15059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789596880.450498:0:15059:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789596880.450499:0:15059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789596880.450501:0:15059:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789596880.450504:0:15059:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789596880.450506:0:15059:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789596880.450507:0:15059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789596880.450508:0:15059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789596880.450509:0:15059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789596880.450510:0:15059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789596880.450511:0:15059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789596880.450512:0:15059:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789596880.450513:0:15059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789596880.450514:0:15059:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789596880.450552:0:15059:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789596880.450573:0:15059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964839040:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789596880.450649:0:15059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596880.450784:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964839040 00000100:00100000:2.0:1789596880.450793:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964839040 00000100:00100000:2.0:1789596880.450853:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789596880.450862:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:15059:x1876527964839040:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789596880.450891:0:14369:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789596880.450894:0:14369:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789596880.450898:0:14369:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789596880.450987:0:15059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c569b480 going to sleep for 11 seconds 00000100:00100000:0.0:1789596880.457470:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:15059:x1876527964839040:12345-0@lo:253:mount.lustre.0 Request processed in 6599us (6810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596880.457485:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789596880.457885:0:15059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964839040:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789596880.457902:0:15059:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789596880.457906:0:15059:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789596880.457908:0:15059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789596880.457909:0:15059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789596880.457910:0:15059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789596880.457912:0:15059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789596880.457913:0:15059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789596880.457915:0:15059:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789596880.457917:0:15059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789596880.457918:0:15059:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789596880.457943:0:15059:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ea8ff34e000 from lustre-OST0000 10000000:01000000:1.0:1789596880.457967:0:15059:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789596880.457969:0:15059:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789596880.457975:0:15059:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ea8c3400000 local copy 00010000:00010000:1.0:1789596880.457985:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d896a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8971 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596880.458331:0:15059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964839168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789596880.458366:0:15059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596880.458446:0:15059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c80ce240 going to sleep for 11 seconds 00000100:00100000:0.0:1789596880.458488:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964839168 00000100:00100000:0.0:1789596880.458494:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964839168 00000100:00100000:0.0:1789596880.458562:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789596880.458570:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6eccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:15059:x1876527964839168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789596880.458730:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6eccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:15059:x1876527964839168:12345-0@lo:501:mount.lustre.0 Request processed in 160us (363us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789596880.458738:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789596880.458848:0:15059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964839168:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789596880.458861:0:15059:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789596880.459016:0:15059:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789596880.459023:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d896a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8971 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.459031:0:15059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d896a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8971 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596880.459064:0:15059:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ea8ff34e000 10000000:01000000:2.0:1789596880.459069:0:15059:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789596880.459074:0:15059:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ea8c3400000 10000000:01000000:2.0:1789596880.459076:0:15059:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789596880.459080:0:15059:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ea8c3400000 from 1 10000000:01000000:2.0:1789596880.459083:0:15059:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789596880.459110:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a82 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.459118:0:15059:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a82 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.459129:0:15059:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a82 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596880.459143:0:15059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6572d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964839296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789596880.459185:0:15059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596880.459479:0:15059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c61a5780 going to sleep for 11 seconds 00000100:00100000:1.0:1789596880.459551:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964839296 00000100:00100000:1.0:1789596880.459556:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964839296 00000100:00100000:1.0:1789596880.459581:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789596880.459588:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+12:15059:x1876527964839296:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789596880.459598:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596880.459613:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8f6a32c00/0x8973ae90b38d8a89 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d8a82 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596880.459633:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8f6a32c00/0x8973ae90b38d8a89 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d8a82 expref: 13 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596880.459643:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8f6a32c00/0x8973ae90b38d8a89 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8a82 expref: 13 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596880.459651:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32c00, rc 0) 00000100:00100000:1.0:1789596880.459729:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+13:15059:x1876527964839296:12345-0@lo:101:mount.lustre.0 Request processed in 141us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596880.459736:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789596880.459942:0:15059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6572d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964839296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789596880.459956:0:15059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a82 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a89 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.459965:0:15059:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a82 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d8a89 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596880.459982:0:15059:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789596880.460002:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a82 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a89 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.460021:0:15059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426600/0x8973ae90b38d8a82 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a89 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596880.460027:0:15059:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789596880.460030:0:15059:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789596880.460035:0:15059:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789596880.460037:0:15059:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789596880.460055:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426000/0x8973ae90b38d8a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.460062:0:15059:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426000/0x8973ae90b38d8a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.460070:0:15059:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426000/0x8973ae90b38d8a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596880.460084:0:15059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6572d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964839424:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789596880.460109:0:15059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596880.460127:0:15059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c61a5780 going to sleep for 11 seconds 00000100:00100000:1.0:1789596880.460194:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964839424 00000100:00100000:1.0:1789596880.460198:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964839424 00000100:00100000:1.0:1789596880.460216:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789596880.460222:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+13:15059:x1876527964839424:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789596880.460229:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596880.460243:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8f6a32200/0x8973ae90b38d8a97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d8a90 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596880.460256:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8f6a32200/0x8973ae90b38d8a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d8a90 expref: 14 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596880.460265:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8f6a32200/0x8973ae90b38d8a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8a90 expref: 14 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596880.460271:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32200, rc 0) 00000100:00100000:1.0:1789596880.460306:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+14:15059:x1876527964839424:12345-0@lo:101:mount.lustre.0 Request processed in 84us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596880.460313:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789596880.460436:0:15059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6572d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964839424:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789596880.460456:0:15059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426000/0x8973ae90b38d8a90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a97 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.460465:0:15059:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426000/0x8973ae90b38d8a90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d8a97 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789596880.461096:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789596880.461976:0:15059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789596880.462248:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789596880.462294:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789596880.462326:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789596880.462375:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789596880.462426:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789596880.462474:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789596880.462555:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789596880.462563:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789596880.462639:0:15059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6572d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964839552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789596880.462694:0:15059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596880.462718:0:15059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c61a5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789596880.463009:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964839552 00000100:00100000:1.0:1789596880.463016:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964839552 00000100:00100000:1.0:1789596880.463048:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789596880.463056:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+14:15059:x1876527964839552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789596880.463378:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+14:15059:x1876527964839552:12345-0@lo:501:mount.lustre.0 Request processed in 321us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596880.463387:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789596880.463647:0:15059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6572d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964839552:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789596880.463681:0:15059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6572d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964839680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789596880.463718:0:15059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596880.463857:0:15059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c61a5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596880.463962:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964839680 00000100:00100000:3.0:1789596880.463967:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964839680 00000100:00100000:1.0:1789596880.464105:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789596880.464113:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+14:15059:x1876527964839680:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789596880.464530:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+14:15059:x1876527964839680:12345-0@lo:503:mount.lustre.0 Request processed in 417us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596880.464538:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789596880.464627:0:15059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6572d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964839680:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789596880.465617:0:15059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789596880.465684:0:15059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6572d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964839808:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789596880.465731:0:15059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596880.465888:0:15059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c61a5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789596880.465926:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964839808 00000100:00100000:1.0:1789596880.465932:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964839808 00000100:00100000:1.0:1789596880.466006:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789596880.466026:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+14:15059:x1876527964839808:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789596880.467710:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+14:15059:x1876527964839808:12345-0@lo:502:mount.lustre.0 Request processed in 1681us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596880.467721:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789596880.467861:0:15059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6572d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964839808:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789596880.468182:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789596880.468239:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789596880.468275:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789596880.468321:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789596880.468359:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789596880.468412:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789596880.468482:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789596880.468518:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789596880.468550:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789596880.468596:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789596880.468633:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789596880.468682:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789596880.468722:0:15059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964839936:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596880.469022:0:15059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.469111:0:15059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d0ee76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596880.469219:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964839936 00000100:00100000:1.0:1789596880.469227:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964839936 00000100:00100000:0.0:1789596880.469404:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789596880.469416:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+14:15059:x1876527964839936:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789596880.469615:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+14:15059:x1876527964839936:12345-0@lo:502:mount.lustre.0 Request processed in 201us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596880.469623:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789596880.469708:0:15059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964839936:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789596880.469882:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789596880.469892:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1789596880.470982:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789596880.470990:0:15073:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789596880.470996:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596880.470999:0:15073:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789596880.471004:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789596880.471018:0:15073:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ea8ffa80000) 00000020:00000080:2.0:1789596880.471037:0:15073:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789596880.471042:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789596880.471104:0:15073:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ea8ff34e000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789596880.471111:0:15073:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789596880.471116:0:15073:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8973ae90b38d8aa5 00010000:00010000:2.0:1789596880.475316:0:15073:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1789596880.475900:0:15073:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1789596880.478084:0:15073:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789596880.480906:0:15073:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789596880.480919:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596880.480925:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596880.480927:0:15073:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789596880.480931:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789596880.480933:0:15073:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1789596880.480935:0:15073:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789596880.480936:0:15073:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789596880.480937:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789596880.480940:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596880.480941:0:15073:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789596880.480943:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596880.480946:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596880.480948:0:15073:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789596880.480950:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789596880.480952:0:15073:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789596880.480954:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596880.480956:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596880.480957:0:15073:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789596880.480959:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596880.480961:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596880.480962:0:15073:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789596880.480965:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789596880.481034:0:15073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596880.481037:0:15073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596880.481038:0:15073:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789596880.481041:0:15073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789596880.481926:0:15059:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789596880.481961:0:15059:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789596880.481981:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426000/0x8973ae90b38d8a90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a97 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596880.481994:0:15059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426000/0x8973ae90b38d8a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8a97 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596880.482002:0:15059:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea8ff34e000 from 1 10000000:01000000:3.0:1789596880.482005:0:15059:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789596880.482044:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89a00/0x8973ae90b38d8aac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596880.482052:0:15059:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89a00/0x8973ae90b38d8aac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596880.482078:0:15059:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89a00/0x8973ae90b38d8aac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596880.482102:0:15059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964840064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789596880.482180:0:15059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.482225:0:15059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d0ee73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596880.482328:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964840064 00000100:00100000:2.0:1789596880.482336:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964840064 00000100:00100000:2.0:1789596880.482385:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789596880.482394:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0c33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+14:15059:x1876527964840064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789596880.482417:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596880.482430:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8ab3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d8aac expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.482462:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8ab3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d8aac expref: 15 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.482473:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8ab3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8aac expref: 15 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.482482:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427c00, rc 0) 00000100:00100000:2.0:1789596880.482520:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0c33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+15:15059:x1876527964840064:12345-0@lo:101:mount.lustre.0 Request processed in 128us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596880.482527:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789596880.482714:0:15059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964840064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789596880.483108:0:15059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89a00/0x8973ae90b38d8aac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8ab3 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596880.483118:0:15059:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89a00/0x8973ae90b38d8aac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d8ab3 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789596880.483780:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789596880.484329:0:15059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789596880.484961:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789596880.485009:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789596880.485069:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789596880.485078:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789596880.485158:0:15059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964840192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596880.485295:0:15059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.485379:0:15059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d0ee73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596880.489259:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964840192 00000100:00100000:1.0:1789596880.489275:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964840192 00000100:00100000:1.0:1789596880.489333:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789596880.489343:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+15:15059:x1876527964840192:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789596880.489659:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+15:15059:x1876527964840192:12345-0@lo:501:mount.lustre.0 Request processed in 317us (4364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596880.489668:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789596880.489911:0:15059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964840192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596880.489963:0:15059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964840320:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789596880.490007:0:15059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.490035:0:15059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d0ee73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596880.491873:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964840320 00000100:00100000:1.0:1789596880.491888:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964840320 00000100:00100000:1.0:1789596880.491934:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789596880.491943:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+15:15059:x1876527964840320:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789596880.492159:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+15:15059:x1876527964840320:12345-0@lo:503:mount.lustre.0 Request processed in 216us (2151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596880.492166:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789596880.492522:0:15059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964840320:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789596880.494007:0:15059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789596880.494077:0:15059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964840448:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596880.494141:0:15059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596880.494183:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964840448 00000100:00100000:0.0:1789596880.494192:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964840448 00000100:00100000:0.0:1789596880.494369:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789596880.494380:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+15:15059:x1876527964840448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789596880.494559:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+15:15059:x1876527964840448:12345-0@lo:502:mount.lustre.0 Request processed in 181us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596880.494612:0:15059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d0ee73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596880.494985:0:15059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964840448:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789596880.495223:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789596880.495274:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789596880.495322:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789596880.495360:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789596880.496553:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789596880.496631:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789596880.496671:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789596880.496703:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1789596880.497181:0:15059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964840576:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596880.497257:0:15059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.497290:0:15059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d0ee73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596880.497531:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964840576 00000100:00100000:2.0:1789596880.497538:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964840576 00000100:00100000:2.0:1789596880.497569:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789596880.497576:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:15059:x1876527964840576:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789596880.497791:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:15059:x1876527964840576:12345-0@lo:502:mount.lustre.0 Request processed in 213us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596880.497808:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789596880.497996:0:15059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964840576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789596880.498121:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789596880.498133:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000100:00100000:0.0:1789596880.499898:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000020:01000000:3.0:1789596880.500311:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596880.500322:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596880.500324:0:15077:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789596880.500332:0:15077:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ea8ff34e000 00000020:00000080:3.0:1789596880.500334:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789596880.500340:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596880.500343:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596880.500344:0:15077:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789596880.500353:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596880.500357:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596880.500358:0:15077:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789596880.500361:0:15077:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ea8ff34e000 00000020:00000080:3.0:1789596880.500362:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789596880.500482:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596880.500487:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596880.500488:0:15077:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789596880.500491:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596880.500493:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596880.500494:0:15077:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789596880.500497:0:15077:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ea8ff34e000 00000020:00000080:3.0:1789596880.500499:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789596880.500534:0:15077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596880.500538:0:15077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596880.500539:0:15077:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789596880.500542:0:15077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789596880.500812:0:15059:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789596880.502642:0:15059:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789596880.502670:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89a00/0x8973ae90b38d8aac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8ab3 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.502684:0:15059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89a00/0x8973ae90b38d8aac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8ab3 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789596880.504798:0:15059:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789596880.504807:0:15059:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ea8ff34e000 10000000:01000000:3.0:1789596880.504811:0:15059:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ea8ff34e000 10000000:01000000:3.0:1789596880.504831:0:15059:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789596880.504840:0:15059:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ea8ff34e000 from 1 10000000:01000000:3.0:1789596880.504843:0:15059:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789596880.504887:0:15059:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d8aba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596880.504899:0:15059:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d8aba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596880.504911:0:15059:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d8aba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596880.504936:0:15059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964840704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789596880.505014:0:15059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.505051:0:15059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d0ee7780 going to sleep for 11 seconds 00000100:00100000:2.0:1789596880.505187:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964840704 00000100:00100000:2.0:1789596880.505195:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964840704 00000100:00100000:2.0:1789596880.505249:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789596880.505258:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+15:15059:x1876527964840704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789596880.505272:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596880.505285:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8ef426200/0x8973ae90b38d8ac1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d8aba expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.505309:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ef426200/0x8973ae90b38d8ac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d8aba expref: 16 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.505320:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8ef426200/0x8973ae90b38d8ac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8aba expref: 16 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.505329:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426200, rc 0) 00000100:00100000:2.0:1789596880.505370:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:15059:x1876527964840704:12345-0@lo:101:mount.lustre.0 Request processed in 112us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596880.505376:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789596880.505594:0:15059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964840704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789596880.505610:0:15059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d8aba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8ac1 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596880.505618:0:15059:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d8aba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d8ac1 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789596880.506606:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789596880.507012:0:15059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789596880.507505:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789596880.507548:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789596880.507581:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789596880.507627:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789596880.507667:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789596880.507733:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789596880.507909:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789596880.507943:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789596880.508009:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789596880.508049:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789596880.508085:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789596880.508133:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789596880.508598:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789596880.508649:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789596880.508703:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789596880.508814:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789596880.508877:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789596880.508943:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789596880.508985:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789596880.509016:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789596880.509071:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789596880.509107:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789596880.509139:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789596880.509697:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789596880.509858:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789596880.509897:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789596880.509947:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789596880.509984:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789596880.510070:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789596880.510078:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1789596880.512326:0:15059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964840832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596880.512485:0:15059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.512541:0:15059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d0ee7780 going to sleep for 11 seconds 00000100:00100000:1.0:1789596880.512610:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964840832 00000100:00100000:1.0:1789596880.512618:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964840832 00000100:00100000:1.0:1789596880.512673:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789596880.512682:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:15059:x1876527964840832:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789596880.512995:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:15059:x1876527964840832:12345-0@lo:501:mount.lustre.0 Request processed in 313us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596880.513002:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789596880.513258:0:15059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964840832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596880.513299:0:15059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964840960:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789596880.513339:0:15059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.513363:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964840960 00000100:00100000:3.0:1789596880.513368:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964840960 00000100:00100000:3.0:1789596880.513840:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789596880.513851:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:15059:x1876527964840960:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789596880.514010:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:15059:x1876527964840960:12345-0@lo:503:mount.lustre.0 Request processed in 163us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596880.514018:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789596880.514057:0:15059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d0ee7780 going to sleep for 11 seconds 00000100:00100000:3.0:1789596880.514071:0:15059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964840960:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789596880.517080:0:15059:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789596880.517168:0:15059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964841088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596880.518982:0:15059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.519023:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964841088 00000100:00100000:3.0:1789596880.519032:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964841088 00000100:00100000:3.0:1789596880.519083:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789596880.519092:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:15059:x1876527964841088:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596880.520886:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:15059:x1876527964841088:12345-0@lo:502:mount.lustre.0 Request processed in 1788us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596880.520899:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789596880.520965:0:15059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d0ee7780 going to sleep for 11 seconds 00000100:00100000:3.0:1789596880.520990:0:15059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964841088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789596880.522985:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789596880.523072:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789596880.523106:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789596880.523151:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789596880.524310:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789596880.524385:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789596880.525319:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789596880.525367:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789596880.525540:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789596880.525578:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789596880.525611:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789596880.525657:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789596880.525694:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789596880.525728:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789596880.526564:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789596880.526606:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789596880.526638:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789596880.526684:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789596880.526720:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789596880.527541:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789596880.527602:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789596880.527637:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789596880.527668:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789596880.527716:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789596880.529729:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1789596880.530309:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1789596880.530380:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1789596880.530860:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1789596880.530899:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1789596880.530966:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1789596880.531004:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1789596880.531036:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1789596880.531063:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1789596880.531110:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1789596880.531145:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1789596880.532330:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1789596880.532390:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1789596880.532874:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1789596880.532934:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1789596880.533880:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1789596880.533946:0:15059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964841216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596880.534032:0:15059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.534082:0:15059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d0ee7780 going to sleep for 11 seconds 00000100:00100000:2.0:1789596880.538548:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964841216 00000100:00100000:2.0:1789596880.538571:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964841216 00000100:00100000:2.0:1789596880.538633:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789596880.538644:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:15059:x1876527964841216:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789596880.538974:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:15059:x1876527964841216:12345-0@lo:502:mount.lustre.0 Request processed in 331us (4942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596880.538982:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789596880.539355:0:15059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964841216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789596880.539511:0:15059:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789596880.539528:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789596880.542037:0:15082:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789596880.542056:0:15082:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ea8f74599c0) 00000020:00000080:3.0:1789596880.542076:0:15082:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789596880.542147:0:15082:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ea8ff34e000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789596880.542159:0:15082:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ea8ff34e000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789596880.542162:0:15082:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ea8ff34e000 3 00010000:00080000:3.0:1789596880.542277:0:15082:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ea7c10a1000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.144@tcp at head 00010000:00010000:3.0:1789596880.545563:0:15082:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1789596880.545811:0:15082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789596880.545884:0:15082:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789596880.545900:0:15082:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8973ae90b38d8acf 00000100:00080000:3.0:1789596880.545912:0:15082:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789596880.545924:0:15082:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ea7c10a1000 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:3.0:1789596880.545967:0:15082:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ea8fa447800 x1876527964841344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789596880.545995:0:15082:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789596880.546500:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876527964841344:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789596880.546570:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596880.546639:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964841344 00000100:00100000:2.0:1789596880.546648:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964841344 00000100:00100000:2.0:1789596880.546678:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789596880.546685:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876527964841344:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789596880.546709:0:14379:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:2.0:1789596880.546756:0:14379:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8973ae90b38d8ad6 00000004:00100000:2.0:1789596880.546773:0:14379:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789596880.546808:0:14379:0:(import.c:65:import_set_state_nolock()) ffff9ea8d2e18000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789596880.546878:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876527964841344:12345-0@lo:38:llog_process_th.0 Request processed in 192us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596880.546885:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789596880.546924:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ea8fa447800 x1876527964841344/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789596890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596880.546934:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789596880.546942:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789596880.546949:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789596880.546953:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789596880.546956:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea7c10a1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789596880.546971:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876527964841344:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789596880.551063:0:15082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789596880.551124:0:15059:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789596880.551148:0:15059:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789596880.551165:0:15059:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d8aba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8ac1 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596880.551190:0:15059:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f88e00/0x8973ae90b38d8aba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8ac1 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789596880.551242:0:15059:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789596880.551245:0:15059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789596880.551247:0:15059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596880.551248:0:15059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596880.551249:0:15059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596880.551251:0:15059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596880.551252:0:15059:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789596880.551254:0:15059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596880.551256:0:15059:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789596880.551260:0:15059:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789596880.551262:0:15059:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789596880.551268:0:15059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789596880.551270:0:15059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596880.551271:0:15059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596880.551272:0:15059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596880.551273:0:15059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596880.551274:0:15059:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789596880.551275:0:15059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596880.551276:0:15059:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789596880.551300:0:15059:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789596880.551319:0:15059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa444e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964841472:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789596880.551385:0:15059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.551423:0:15059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c813c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596880.551460:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964841472 00000100:00100000:3.0:1789596880.551468:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964841472 00000100:00100000:3.0:1789596880.551512:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789596880.551520:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:15059:x1876527964841472:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789596880.551558:0:14369:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789596880.551572:0:14369:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:2.0:1789596880.557927:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789596880.557938:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789596880.557940:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789596880.557943:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789596880.558517:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964841600:0@lo:400:kworker.0 00000100:00100000:3.0:1789596880.558587:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596880.558640:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964841600 00000100:00100000:3.0:1789596880.558648:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964841600 00000100:00100000:3.0:1789596880.558690:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789596880.558699:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964841600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596880.558761:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964841600:12345-0@lo:400:kworker.0 Request processed in 63us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596880.558768:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789596880.558807:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ea8f6571c00 x1876527964841600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596880.558841:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964841600:0@lo:400:kworker.0 20000000:01000000:2.0:1789596880.592766:0:14369:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789596880.592789:0:14369:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789596880.593212:0:14393:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789596880.593218:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789596880.593243:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ea8f6a33c00/0x8973ae90b38d8add lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596880.593263:0:14393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8a4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8a43 expref: 16 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596880.593291:0:14393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ea8f6a33c00/0x8973ae90b38d8add lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596880.593334:0:14393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d8a43 expref: 16 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596880.593348:0:14393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8a4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d8a43 expref: 16 pid: 14372 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596880.593363:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1876527964841728:0@lo:104: 00000100:00100000:1.0:1789596880.593452:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596880.593489:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6f0e900 going to sleep for 11 seconds 00000100:00100000:2.0:1789596880.593789:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964841728 00000100:00100000:2.0:1789596880.593796:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964841728 00000100:00100000:2.0:1789596880.593861:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789596880.593870:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa65a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+3:14393:x1876527964841728:12345-0@lo:104: 00010000:00010000:2.0:1789596880.593883:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33a00/0x8973ae90b38d8a43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d8a4a expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.593941:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789596880.593947:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa65a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+3:14393:x1876527964841728:12345-0@lo:104: Request processed in 79us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596880.593954:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789596880.593980:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596880.593985:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33a00/0x8973ae90b38d8a43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d8a4a expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.593992:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a33a00 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596880.593995:0:14365:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33a00/0x8973ae90b38d8a43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d8a4a expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.594004:0:14365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33a00/0x8973ae90b38d8a43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d8a4a expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596880.594021:0:14365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33a00/0x8973ae90b38d8a43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d8a4a expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596880.594027:0:14365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596880.594058:0:14365:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33a00/0x8973ae90b38d8a43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8a4a expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.594065:0:14365:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596880.594086:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33a00/0x8973ae90b38d8a43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8a4a expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.594093:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33a00/0x8973ae90b38d8a43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8a4a expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.594107:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596880.594109:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596880.594110:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596880.594127:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3309:1876527964841856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596880.594161:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596880.594311:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964841856 00000100:00100000:2.0:1789596880.594316:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964841856 00010000:00010000:2.0:1789596880.594334:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8a4a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d8a43 expref: 17 pid: 14372 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596880.594356:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789596880.594362:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6572d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+17:3309:x1876527964841856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596880.594371:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596880.594376:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8a4a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d8a43 expref: 17 pid: 14372 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.594391:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8a4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d8a43 expref: 17 pid: 14372 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.594875:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ea8f6a33c00/0x8973ae90b38d8add lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.594886:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8f6a33c00/0x8973ae90b38d8add lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789596880.594900:0:14362:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001682652s 00010000:00010000:2.0:1789596880.594904:0:14362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8f6a33c00/0x8973ae90b38d8add lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.594911:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8f6a33c00/0x8973ae90b38d8add lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.594917:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ea8f6a33c00/0x8973ae90b38d8add lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.594924:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ea8f6a33c00/0x8973ae90b38d8add lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.594930:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a33c00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596880.594934:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ea8f6a33c00/0x8973ae90b38d8add lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.594942:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ea8f6a33c00/0x8973ae90b38d8add lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.594950:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ea8f6a33c00/0x8973ae90b38d8add lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596880.594967:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596880.595006:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6572d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+17:3309:x1876527964841856:12345-0@lo:103:ldlm_bl.0 Request processed in 644us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596880.595013:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789596880.595055:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3309:1876527964841856:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789596880.596229:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8a4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d8a43 expref: 16 pid: 14372 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596880.596244:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1876527964841728:0@lo:104: 00010000:00010000:1.0:1789596880.596260:0:14393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ea8f6a33c00/0x8973ae90b38d8add lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596880.596270:0:14393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ea8f6a33c00/0x8973ae90b38d8add lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596880.596276:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ea8f6a33c00/0x8973ae90b38d8add lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596880.596283:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8f6a33c00/0x8973ae90b38d8add lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596880.604156:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+15:15059:x1876527964841472:12345-0@lo:253:mount.lustre.0 Request processed in 52627us (52760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596880.604183:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789596880.604338:0:15059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa444e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15059:1876527964841472:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789596880.604351:0:15059:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789596880.604355:0:15059:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789596880.604357:0:15059:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789596880.604358:0:15059:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789596880.604360:0:15059:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789596880.604361:0:15059:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789596880.604362:0:15059:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789596880.604364:0:15059:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789596880.604366:0:15059:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789596880.604367:0:15059:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789596880.604380:0:15059:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789596880.611965:0:15059:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789596880.612131:0:15059:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789596880.612382:0:15059:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789596880.612634:0:15059:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789596880.612978:0:15059:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789596880.613154:0:15059:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789596880.614188:0:15059:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789596880.658473:0:15059:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789596880.658495:0:15059:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789596880.658529:0:15059:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789596880.658587:0:15059:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.144@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789596880.658601:0:15059:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789596880.658627:0:15059:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789596881.252423:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789596881.946977:0:14374:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789596881.946988:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ea7c29c1800 from 7 10000000:01000000:2.0:1789596881.946994:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789596881.947056:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427400/0x8973ae90b38d8ae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596881.947072:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427400/0x8973ae90b38d8ae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596881.947090:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427400/0x8973ae90b38d8ae4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596881.947130:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6571c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964841984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789596881.947222:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596881.947321:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c313e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789596881.948175:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964841984 00000100:00100000:3.0:1789596881.948190:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964841984 00000100:00100000:3.0:1789596881.948309:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789596881.948320:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+15:14374:x1876527964841984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596881.948340:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596881.948360:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d8aeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d8ae4 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596881.948401:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d8aeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d8ae4 expref: 16 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596881.948416:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d8aeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8ae4 expref: 16 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596881.948435:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f89800, rc 0) 00000100:00100000:3.0:1789596881.948506:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:14374:x1876527964841984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596881.948513:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789596881.948650:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6571c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964841984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596881.948671:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427400/0x8973ae90b38d8ae4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8aeb expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596881.948703:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427400/0x8973ae90b38d8ae4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d8aeb expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596881.948772:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6571c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964842112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789596881.948870:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596881.948922:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c313e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789596881.951678:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964842112 00000100:00100000:0.0:1789596881.951700:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964842112 00000100:00100000:0.0:1789596881.951791:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789596881.951802:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:14374:x1876527964842112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789596881.951852:0:14369:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789596881.951872:0:14369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789596881.951875:0:14369:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789596881.952042:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:14374:x1876527964842112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 241us (3173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596881.952051:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789596881.952123:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6571c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964842112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789596881.952204:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789596881.952217:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427400/0x8973ae90b38d8ae4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8aeb expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596881.952229:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427400/0x8973ae90b38d8ae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8aeb expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596882.269338:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596883.305549:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596884.315967:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596885.344318:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789596886.044687:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789596886.044695:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789596886.044698:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789596886.044701:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789596886.044756:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3306:1876527964842240:0@lo:400:kworker.0 00000100:00100000:1.0:1789596886.044870:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964842496:0@lo:400:kworker.0 00000100:00100000:1.0:1789596886.044913:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596886.044979:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876527964842368:0@lo:400:kworker.0 00000100:00100000:1.0:1789596886.045005:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596886.048567:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596886.048666:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964842496 00000100:00100000:2.0:1789596886.048676:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964842496 00000100:00100000:2.0:1789596886.048723:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964842368 00000100:00100000:2.0:1789596886.048726:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964842368 00000100:00100000:2.0:1789596886.048743:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789596886.048752:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa65a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964842496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596886.048845:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa65a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964842496:12345-0@lo:400:kworker.0 Request processed in 95us (3931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596886.048852:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789596886.048869:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789596886.048874:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876527964842368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596886.048919:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876527964842368:12345-0@lo:400:kworker.0 Request processed in 45us (3913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596886.048925:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789596886.048964:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8f6571500 x1876527964842496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596886.048979:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964842496:0@lo:400:kworker.0 00010000:00080000:2.0:1789596886.049014:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8f6573800 x1876527964842368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596902 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596886.049023:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876527964842368:0@lo:400:kworker.0 00000100:00100000:3.0:1789596886.055324:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964842240 00000100:00100000:3.0:1789596886.055339:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964842240 00000100:00100000:3.0:1789596886.055410:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789596886.055434:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:3306:x1876527964842240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596886.055537:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:3306:x1876527964842240:12345-0@lo:400:kworker.0 Request processed in 107us (6976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596886.055544:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1789596886.055588:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596886.057844:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3306:1876527964842240:0@lo:400:kworker.0 00010000:00010000:1.0:1789596886.364594:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596887.391774:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789596887.706728:0:15426:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg244-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1789596887.771682:0:14409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789596888.418034:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596889.440695:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.465979:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596890.779607:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596875/real 1789596875] req@ffff9ea8f6571f80 x1876527964838656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596890 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596890.779653:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ea8f6571f80 x1876527964838656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596890 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596890.779665:0:3305:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789596875/real 1789596875] req@ffff9ea8f6570e00 x1876527964838784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596890 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596890.779676:0:3305:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ea8f6570e00 x1876527964838784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789596890 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789596890.779697:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8f7460000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789596890.779727:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789596890.779732:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964838656:0@lo:8:kworker.0 00000100:00080000:3.0:1789596890.779738:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8c86d0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789596890.779744:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789596890.779747:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964838784:0@lo:8:kworker.0 00000100:00080000:1.0:1789596890.781181:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789596890.781189:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789596890.781193:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ea8f7460000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789596890.781212:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:1.0:1789596890.781220:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789596890.781235:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ea8f7460000 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:1.0:1789596890.781267:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ea8fa65b480 x1876527964842752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789596890.781293:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789596890.781297:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789596890.781299:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ea8c86d0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789596890.781303:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:1.0:1789596890.781306:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789596890.781311:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ea8c86d0800 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:1.0:1789596890.781324:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ea8fa659f80 x1876527964842880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789596890.781397:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964843008:0@lo:400:kworker.0 00000100:00100000:1.0:1789596890.781497:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596890.781563:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789596890.781571:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964843136:0@lo:400:kworker.0 00000100:00100000:1.0:1789596890.781595:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596890.781656:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964843008 00000100:00100000:1.0:1789596890.781667:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964843008 00000100:00100000:1.0:1789596890.781721:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964843136 00000100:00100000:1.0:1789596890.781725:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964843136 00000100:00100000:1.0:1789596890.781757:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789596890.781767:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964843008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596890.781857:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964843008:12345-0@lo:400:kworker.0 Request processed in 90us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596890.781864:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789596890.781884:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789596890.781891:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964843136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596890.782358:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3309:1876527964842624:0@lo:400:kworker.0 00000100:00100000:2.0:1789596890.782409:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596890.782471:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964842624 00000100:00100000:2.0:1789596890.782476:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964842624 00000100:00100000:2.0:1789596890.782508:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789596890.782516:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:3309:x1876527964842624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596890.782554:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:3309:x1876527964842624:12345-0@lo:400:kworker.0 Request processed in 39us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596890.782560:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789596890.782608:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3309:1876527964842624:0@lo:400:kworker.0 00000100:00080000:2.0:1789596890.783566:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596890.783594:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964842752:0@lo:8:kworker.0 00000100:00100000:1.0:1789596890.783873:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964843136:12345-0@lo:400:kworker.0 Request processed in 1981us (2275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596890.783881:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789596890.784774:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596890.784853:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964842880:0@lo:8:kworker.0 00000100:00100000:2.0:1789596890.784890:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789596890.785122:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8fa659880 x1876527964843136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596890.785142:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964843136:0@lo:400:kworker.0 00010000:00080000:1.0:1789596890.785160:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8fa658700 x1876527964843008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789596890.785170:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964843008:0@lo:400:kworker.0 00000100:00100000:0.0:1789596890.793236:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964842752 00000100:00100000:0.0:1789596890.793259:0:15062:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964842752 00000100:00100000:0.0:1789596890.793321:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964842880 00000100:00100000:0.0:1789596890.793333:0:15062:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964842880 00000100:00100000:0.0:1789596890.793369:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789596890.793379:0:15062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876527964842752:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789596890.793421:0:15062:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:0.0:1789596890.793463:0:15062:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8973ae90b38d8af2 00002000:00100000:0.0:1789596890.793483:0:15062:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ea8c301f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789596890.793487:0:15062:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789596890.793490:0:15062:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789596890.795096:0:15062:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789596890.795307:0:15062:0:(import.c:65:import_set_state_nolock()) ffff9ea8c301d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596890.795439:0:15062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876527964842752:12345-0@lo:8:kworker.0 Request processed in 2058us (10665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596890.795451:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789596890.795489:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789596890.795495:0:15062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876527964842880:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789596890.795514:0:15062:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789596890.795545:0:15062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6571500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876527964842880:12345-0@lo:8:kworker.0 Request processed in 50us (10655us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789596890.795551:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789596890.795859:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8fa65b480 x1876527964842752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789596910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596890.795872:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789596890.795882:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789596890.795903:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789596890.795909:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789596890.795911:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8f7460000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789596890.795939:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789596890.795945:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964842752:0@lo:8:kworker.0 00000100:00080000:2.0:1789596890.795961:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8c86d0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789596890.795966:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789596890.795968:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964842880:0@lo:8:kworker.0 00000004:00080000:2.0:1789596890.796006:0:14399:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789596890.796382:0:14399:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 475760564374ns, next at 0ns, rc = 0 00000004:00080000:0.0:1789596890.797840:0:14400:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1789596890.797879:0:14400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14400:1876527964843392:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789596890.797954:0:14400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596890.797990:0:14400:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c50cb240 going to sleep for 11 seconds 00000100:00100000:2.0:1789596890.798227:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964843264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596890.798264:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596890.798324:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964843264 00000100:00100000:2.0:1789596890.798333:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964843264 00000100:00100000:2.0:1789596890.798421:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789596890.798436:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876527964843264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596890.798480:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789596890.798541:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6571880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876527964843264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596890.798548:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789596890.798589:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789596890.798639:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8c6ec1180 x1876527964843264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596890.798674:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964843264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596890.799400:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964843392 00000100:00100000:0.0:1789596890.799412:0:15062:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964843392 00000100:00100000:0.0:1789596890.799452:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789596890.799466:0:15062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14400:x1876527964843392:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789596890.803492:0:15062:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789596890.803504:0:15062:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1789596890.803511:0:15062:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:0.0:1789596890.811999:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.812009:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8af9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812022:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.812025:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.812030:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8af9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812044:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8af9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812052:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8af9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812057:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8af9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812072:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596890.812087:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596890.812091:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8af9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812104:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6c00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596890.812107:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8af9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812114:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8af9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812126:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8af9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812130:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8af9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812143:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.812144:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.812145:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.812493:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.812500:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812508:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.812510:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.812514:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812524:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812538:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812546:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812559:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596890.812566:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596890.812569:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812574:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596890.812576:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812582:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812589:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812593:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.812602:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.812607:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.812608:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.812990:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.812997:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.813006:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.813009:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.813013:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.813022:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.813029:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.813036:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.813049:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596890.813057:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596890.813061:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.813067:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7a00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596890.813071:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.813092:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.813102:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.813109:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.813123:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.813125:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.813126:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.816755:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.816769:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.816785:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.816790:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.816797:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.816812:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.816865:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.816882:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.816930:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596890.816944:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596890.816950:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.816959:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6400 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596890.816963:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.816974:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.816991:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.816999:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.817022:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.817024:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.817026:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.823900:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.823931:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.823948:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.823954:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.823960:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.823978:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.823989:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.823998:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.824021:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596890.824035:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596890.824041:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.824050:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7000 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596890.824055:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.824065:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.824090:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.824098:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.824610:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.824614:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.824617:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.828609:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.828623:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.828640:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.828645:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.828652:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.828667:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.828677:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.828686:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.828731:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789596890.829645:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.829653:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.829664:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.829669:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.829673:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.829687:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.829697:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.829703:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.829727:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789596890.829743:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789596890.829748:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.829756:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596890.829769:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.829779:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.829797:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.829805:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.829875:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596890.829879:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.829886:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6c00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596890.829889:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.829898:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.829911:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b23 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.829919:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.829942:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.829944:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.829946:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596890.831240:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.832009:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.832021:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.832036:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.832040:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.832046:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.832060:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.832069:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.832445:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.832468:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596890.832483:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596890.832489:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.832510:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7c00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596890.832515:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.832524:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.832541:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.832549:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.832588:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.832591:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.832595:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.835806:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.835846:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.835864:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.835869:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.835876:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.835892:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.835912:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.835920:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.835952:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596890.836954:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596890.836973:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.836987:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7a00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596890.836993:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.837005:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.837035:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.837043:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.837070:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596890.837072:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596890.837074:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.837813:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.837844:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.837858:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.837864:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.837871:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.837886:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.837895:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.837903:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.837938:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596890.837958:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596890.837965:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.837973:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6a00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596890.837978:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.837988:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.838004:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.838011:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.838030:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.838031:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.838033:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.841052:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.841066:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.841082:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.841092:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.841099:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.841115:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.841138:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.841147:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.841168:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789596890.841393:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596890.841401:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.841423:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7000 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:3.0:1789596890.841428:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.841438:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.841458:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.841466:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001df1bbfd/0x8973ae90b38d8b3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.841490:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596890.841492:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596890.841494:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.842136:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.842144:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.842154:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.842157:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.842162:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.842173:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.842182:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.842195:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.842480:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596890.842522:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596890.842527:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.842534:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6400 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596890.842537:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.842545:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.842557:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.842563:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d551dfb1/0x8973ae90b38d8b46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.842577:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.842579:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.842580:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.843469:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.843554:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030166696/0x8973ae90b38d8b4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.843568:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.843572:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.843577:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030166696/0x8973ae90b38d8b4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.843631:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030166696/0x8973ae90b38d8b4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.843641:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030166696/0x8973ae90b38d8b4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.843650:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030166696/0x8973ae90b38d8b4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.843667:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789596890.844104:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.844110:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8b54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844131:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.844134:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.844139:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8b54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844149:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8b54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844163:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8b54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844171:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8b54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844184:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789596890.844193:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789596890.844197:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030166696/0x8973ae90b38d8b4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844213:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7200 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596890.844218:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030166696/0x8973ae90b38d8b4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844228:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030166696/0x8973ae90b38d8b4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844242:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030166696/0x8973ae90b38d8b4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844250:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030166696/0x8973ae90b38d8b4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844266:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596890.844274:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8b54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844354:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7e00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596890.844358:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8b54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844367:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8b54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844378:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8b54 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844386:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8b54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844399:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.844401:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.844403:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.844749:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.844755:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ff17604/0x8973ae90b38d8b5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844765:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.844769:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.844774:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ff17604/0x8973ae90b38d8b5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844797:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ff17604/0x8973ae90b38d8b5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844805:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ff17604/0x8973ae90b38d8b5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844813:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ff17604/0x8973ae90b38d8b5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844880:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596890.844888:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596890.844892:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ff17604/0x8973ae90b38d8b5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844900:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6000 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596890.844904:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ff17604/0x8973ae90b38d8b5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844913:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ff17604/0x8973ae90b38d8b5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844929:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ff17604/0x8973ae90b38d8b5b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844937:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ff17604/0x8973ae90b38d8b5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.844960:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.844964:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.844966:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596890.847915:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.850189:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.850216:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.850233:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.850238:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.850245:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.850260:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.850271:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.850871:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.850919:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596890.850937:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596890.850944:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.850969:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6a00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596890.850974:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.850983:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.850999:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b62 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.851006:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fea47761/0x8973ae90b38d8b62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.851025:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.851027:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.851029:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.851845:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.851855:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.851866:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.851870:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.851875:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.851888:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.851902:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.851909:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.851929:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596890.851960:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596890.851988:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.852003:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7c00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596890.852008:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.852021:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.852045:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.852054:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d00686d/0x8973ae90b38d8b69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.852094:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596890.852097:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596890.852100:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.853700:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.853711:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.853723:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.853726:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.853732:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.853745:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.853755:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.853763:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.853790:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596890.853801:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596890.853806:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.853813:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6c00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596890.853833:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.853843:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.853859:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.853866:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000510f3749/0x8973ae90b38d8b70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.853883:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.853885:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.853887:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.865325:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.865340:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.865367:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.865382:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.865390:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.865405:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.865416:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.865423:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.865445:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596890.865930:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596890.865946:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.865963:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596890.865970:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.866008:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.866036:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b77 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.866046:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4050ea0/0x8973ae90b38d8b77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789596890.866064:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.866073:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5af9b6c/0x8973ae90b38d8b7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.866085:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.866088:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596890.866091:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.866093:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5af9b6c/0x8973ae90b38d8b7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.866096:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596890.866101:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596890.866113:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5af9b6c/0x8973ae90b38d8b7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.866122:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5af9b6c/0x8973ae90b38d8b7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.866136:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5af9b6c/0x8973ae90b38d8b7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.866161:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596890.866378:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596890.866386:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5af9b6c/0x8973ae90b38d8b7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.866396:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6600 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596890.866400:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5af9b6c/0x8973ae90b38d8b7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.866409:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5af9b6c/0x8973ae90b38d8b7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.866426:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5af9b6c/0x8973ae90b38d8b7e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.866449:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5af9b6c/0x8973ae90b38d8b7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.866482:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596890.866487:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596890.866490:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.866576:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.866582:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e88b364f/0x8973ae90b38d8b85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.866592:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.866595:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.866600:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e88b364f/0x8973ae90b38d8b85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.866610:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e88b364f/0x8973ae90b38d8b85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.866617:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e88b364f/0x8973ae90b38d8b85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.866623:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e88b364f/0x8973ae90b38d8b85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.866643:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596890.866723:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596890.866731:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e88b364f/0x8973ae90b38d8b85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.866741:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7600 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596890.866745:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e88b364f/0x8973ae90b38d8b85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.866753:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e88b364f/0x8973ae90b38d8b85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.866765:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e88b364f/0x8973ae90b38d8b85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.866773:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e88b364f/0x8973ae90b38d8b85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.866811:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596890.866844:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596890.866846:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.867096:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.867104:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.867118:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.867121:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.867125:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.867135:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.867144:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.867152:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.867171:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596890.867220:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596890.867229:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.867239:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7a00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596890.867244:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.867254:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.867272:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b8c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.867281:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035c33d07/0x8973ae90b38d8b8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.867304:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596890.867307:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596890.867309:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.867566:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.867574:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c03c872f/0x8973ae90b38d8b93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.867582:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.867585:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.867589:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c03c872f/0x8973ae90b38d8b93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.867598:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c03c872f/0x8973ae90b38d8b93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.867616:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c03c872f/0x8973ae90b38d8b93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.867624:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c03c872f/0x8973ae90b38d8b93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.867644:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596890.867741:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596890.867749:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c03c872f/0x8973ae90b38d8b93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.867758:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596890.867762:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c03c872f/0x8973ae90b38d8b93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.867801:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c03c872f/0x8973ae90b38d8b93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.867847:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c03c872f/0x8973ae90b38d8b93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.867856:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c03c872f/0x8973ae90b38d8b93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.867885:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596890.867887:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596890.867889:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.868079:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.868087:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce67d80f/0x8973ae90b38d8b9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.868095:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.868099:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.868103:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce67d80f/0x8973ae90b38d8b9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.868112:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce67d80f/0x8973ae90b38d8b9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.868121:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce67d80f/0x8973ae90b38d8b9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.868129:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce67d80f/0x8973ae90b38d8b9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.868157:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596890.868630:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596890.868638:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce67d80f/0x8973ae90b38d8b9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.868657:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031200 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596890.868661:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce67d80f/0x8973ae90b38d8b9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.868669:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce67d80f/0x8973ae90b38d8b9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.868682:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce67d80f/0x8973ae90b38d8b9a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.868703:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce67d80f/0x8973ae90b38d8b9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596890.868730:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596890.868732:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596890.868735:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789596890.870963:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.870976:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c985b7e3/0x8973ae90b38d8ba1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.870991:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.870995:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.871000:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c985b7e3/0x8973ae90b38d8ba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.871013:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c985b7e3/0x8973ae90b38d8ba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.871023:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c985b7e3/0x8973ae90b38d8ba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.871030:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c985b7e3/0x8973ae90b38d8ba1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.871047:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789596890.871772:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.871779:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dd31852/0x8973ae90b38d8ba8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.871788:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.871797:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.871802:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dd31852/0x8973ae90b38d8ba8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.871829:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005dd31852/0x8973ae90b38d8ba8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.871839:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dd31852/0x8973ae90b38d8ba8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.871846:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005dd31852/0x8973ae90b38d8ba8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.871860:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789596890.876128:0:15062:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789596890.876143:0:15062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000134d3a9e/0x8973ae90b38d8baf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.876161:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=475s v=(0 0) 00010000:00010000:0.0:1789596890.876165:0:15062:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596890.876171:0:15062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000134d3a9e/0x8973ae90b38d8baf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.876185:0:15062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000134d3a9e/0x8973ae90b38d8baf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.876196:0:15062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000134d3a9e/0x8973ae90b38d8baf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.876211:0:15062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000134d3a9e/0x8973ae90b38d8baf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596890.876222:0:15062:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789596890.876403:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789596890.876414:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c985b7e3/0x8973ae90b38d8ba1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.876424:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030200 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:3.0:1789596890.876429:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c985b7e3/0x8973ae90b38d8ba1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.876440:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c985b7e3/0x8973ae90b38d8ba1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.876465:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c985b7e3/0x8973ae90b38d8ba1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.876474:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c985b7e3/0x8973ae90b38d8ba1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.876496:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789596890.876500:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005dd31852/0x8973ae90b38d8ba8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.876506:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030000 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:3.0:1789596890.876510:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005dd31852/0x8973ae90b38d8ba8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.876517:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005dd31852/0x8973ae90b38d8ba8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.876529:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005dd31852/0x8973ae90b38d8ba8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.876536:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005dd31852/0x8973ae90b38d8ba8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.876559:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596890.876562:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000134d3a9e/0x8973ae90b38d8baf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.876574:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031c00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:3.0:1789596890.876579:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000134d3a9e/0x8973ae90b38d8baf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.876589:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000134d3a9e/0x8973ae90b38d8baf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.876605:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000134d3a9e/0x8973ae90b38d8baf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.876612:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000134d3a9e/0x8973ae90b38d8baf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596890.876633:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596890.876635:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596890.876636:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789596890.876800:0:15062:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00010000:00010000:2.0:1789596890.877367:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596890.877584:0:15062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14400:x1876527964843392:12345-0@lo:5:osp-pre-0-0.0 Request processed in 78112us (79625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596890.877595:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789596890.877912:0:14400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14400:1876527964843392:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789596890.877942:0:14400:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1789596890.878000:0:14400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa658700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14400:1876527964843520:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789596890.878042:0:14400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596890.878108:0:14400:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d1052300 going to sleep for 11 seconds 00000100:00100000:1.0:1789596890.878143:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964843520 00000100:00100000:1.0:1789596890.878150:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964843520 00000100:00100000:1.0:1789596890.878193:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789596890.878201:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14400:x1876527964843520:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789596890.878423:0:15063:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000004:00080000:3.0:1789596890.891755:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789596890.900109:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14400:x1876527964843520:12345-0@lo:5:osp-pre-0-0.0 Request processed in 21898us (22056us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789596890.900123:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789596890.900414:0:14400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa658700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14400:1876527964843520:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789596890.900431:0:14400:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00100000:3.0:1789596891.256861:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789596891.256983:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1789596891.483890:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596892.508032:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596893.531649:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789596894.525915:0:15778:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789596894.525920:0:15778:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789596894.526023:0:15778:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ea8f9e94000 00000020:01000004:1.0:1789596894.526040:0:15778:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789596894.526053:0:15778:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789596894.526067:0:15778:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ea8c6e20000) 00000020:00000080:1.0:1789596894.526083:0:15778:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00010000:00010000:1.0:1789596894.562364:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789596894.569854:0:15778:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789596894.570691:0:15778:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789596894.576753:0:15778:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789596894.577058:0:15778:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789596894.577512:0:15778:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789596894.577937:0:15778:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 583: rc = 0 00100000:10000000:2.0:1789596894.578051:0:15778:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 583: rc = 0 00100000:10000000:2.0:1789596894.578150:0:15778:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 583: rc = 0 00100000:10000000:3.0:1789596894.580051:0:15778:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 53: rc = 0 00100000:10000000:3.0:1789596894.584983:0:15778:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 53: rc = 0 00100000:10000000:3.0:1789596894.592765:0:15778:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 53: rc = 0 00100000:10000000:3.0:1789596894.593136:0:15778:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 53: rc = 0 00100000:10000000:3.0:1789596894.593436:0:15778:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 53: rc = 0 00100000:10000000:3.0:1789596894.593691:0:15778:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 53: rc = 0 00000020:00000080:3.0:1789596894.594293:0:15778:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789596894.594307:0:15778:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789596894.594330:0:15778:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8973ae90b38d8bbd 00000020:01000004:3.0:1789596894.594337:0:15778:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789596894.594358:0:15778:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.144@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789596894.594361:0:15778:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789596894.594367:0:15778:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789596894.594387:0:15778:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789596894.594391:0:15778:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.144@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789596894.622536:0:15778:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.144@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789596894.622575:0:15778:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.144@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789596894.622580:0:15778:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789596894.622581:0:15778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789596894.622583:0:15778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596894.622584:0:15778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789596894.622585:0:15778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596894.622587:0:15778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596894.622588:0:15778:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789596894.622590:0:15778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596894.622591:0:15778:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789596894.622594:0:15778:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789596894.622601:0:15778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789596894.622602:0:15778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789596894.622604:0:15778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596894.622604:0:15778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789596894.622605:0:15778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596894.622606:0:15778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596894.622607:0:15778:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789596894.622608:0:15778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596894.622609:0:15778:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789596894.622635:0:15778:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789596894.622658:0:15778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6573480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964843648:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789596894.622733:0:15778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596894.622930:0:15778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6f086c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596894.622998:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964843648 00000100:00100000:3.0:1789596894.623006:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964843648 00000100:00100000:3.0:1789596894.623135:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789596894.623146:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:15778:x1876527964843648:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789596894.623187:0:14369:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789596894.623190:0:14369:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789596894.623194:0:14369:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789596894.639328:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:15778:x1876527964843648:12345-0@lo:253:mount.lustre.0 Request processed in 16167us (16578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596894.639344:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789596894.639628:0:15778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6573480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964843648:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789596894.639646:0:15778:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789596894.639649:0:15778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789596894.639651:0:15778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789596894.639653:0:15778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789596894.639654:0:15778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789596894.639655:0:15778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789596894.639656:0:15778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789596894.639658:0:15778:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789596894.639659:0:15778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789596894.639661:0:15778:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789596894.639680:0:15778:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ea8f9e94000 from lustre-OST0001 10000000:01000000:2.0:1789596894.639709:0:15778:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789596894.639712:0:15778:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789596894.639720:0:15778:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ea8c3400000 local copy 00010000:00010000:2.0:1789596894.639730:0:15778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d896a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8971 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596894.640031:0:15778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6573480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964843776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789596894.640076:0:15778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596894.640112:0:15778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6f08cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596894.640199:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964843776 00000100:00100000:3.0:1789596894.640207:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964843776 00000100:00100000:3.0:1789596894.640259:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789596894.640268:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:15778:x1876527964843776:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789596894.640447:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:15778:x1876527964843776:12345-0@lo:501:mount.lustre.0 Request processed in 180us (370us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789596894.640455:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789596894.640780:0:15778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6573480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964843776:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789596894.640795:0:15778:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789596894.640988:0:15778:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789596894.640996:0:15778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d896a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8971 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596894.641006:0:15778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426a00/0x8973ae90b38d896a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8971 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596894.641029:0:15778:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ea8f9e94000 10000000:01000000:0.0:1789596894.641034:0:15778:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789596894.641058:0:15778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789596894.641061:0:15778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789596894.641066:0:15778:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789596894.641069:0:15778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789596894.641098:0:15778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d8bc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596894.641107:0:15778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d8bc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596894.641116:0:15778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d8bc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596894.641131:0:15778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964843904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789596894.641164:0:15778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596894.641194:0:15778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f694a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789596894.641457:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964843904 00000100:00100000:3.0:1789596894.641463:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964843904 00000100:00100000:3.0:1789596894.641501:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789596894.641508:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:15778:x1876527964843904:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789596894.641519:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596894.641539:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d8bcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d8bc4 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596894.641559:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d8bcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d8bc4 expref: 17 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596894.641570:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8d5f88800/0x8973ae90b38d8bcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8bc4 expref: 17 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596894.641577:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8d5f88800, rc 0) 00000100:00100000:3.0:1789596894.641607:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+17:15778:x1876527964843904:12345-0@lo:101:mount.lustre.0 Request processed in 99us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596894.641614:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789596894.641734:0:15778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964843904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789596894.641747:0:15778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d8bc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8bcb expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596894.641756:0:15778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d8bc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d8bcb expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789596894.642970:0:15778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789596894.645958:0:15778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789596894.646697:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789596894.646748:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789596894.646779:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789596894.646868:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789596894.646906:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789596894.646953:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789596894.647025:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789596894.647033:0:15778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789596894.652432:0:15778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6573b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964844032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789596894.652509:0:15778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596894.652604:0:15778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6f08600 going to sleep for 11 seconds 00000100:00100000:0.0:1789596894.656212:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964844032 00000100:00100000:0.0:1789596894.656228:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964844032 00000100:00100000:0.0:1789596894.656307:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789596894.656327:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900450c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+17:15778:x1876527964844032:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789596894.657033:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900450c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+17:15778:x1876527964844032:12345-0@lo:501:mount.lustre.0 Request processed in 705us (4521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596894.657054:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789596894.660172:0:15778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6573b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964844032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789596894.660400:0:15778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6573b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964844160:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789596894.660483:0:15778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596894.660537:0:15778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6f08600 going to sleep for 11 seconds 00000100:00100000:3.0:1789596894.660650:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964844160 00000100:00100000:3.0:1789596894.660660:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964844160 00000100:00100000:3.0:1789596894.660709:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789596894.660718:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+17:15778:x1876527964844160:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789596894.661138:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+17:15778:x1876527964844160:12345-0@lo:503:mount.lustre.0 Request processed in 419us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596894.661147:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789596894.661476:0:15778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6573b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964844160:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789596894.662450:0:15778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789596894.662532:0:15778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6573b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964844288:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789596894.662587:0:15778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596894.662633:0:15778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6f08600 going to sleep for 11 seconds 00000100:00100000:0.0:1789596894.662724:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964844288 00000100:00100000:0.0:1789596894.662731:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964844288 00000100:00100000:0.0:1789596894.662775:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789596894.662783:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+17:15778:x1876527964844288:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789596894.663014:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+17:15778:x1876527964844288:12345-0@lo:502:mount.lustre.0 Request processed in 232us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596894.663024:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789596894.663376:0:15778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6573b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964844288:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789596894.663618:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789596894.663666:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789596894.663700:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789596894.663743:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789596894.663781:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789596894.663809:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789596894.663901:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789596894.663936:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789596894.664002:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1789596894.664033:0:15778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6573b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964844416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596894.675577:0:15778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596894.675679:0:15778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6f08600 going to sleep for 11 seconds 00000100:00100000:0.0:1789596894.682991:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964844416 00000100:00100000:0.0:1789596894.683009:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964844416 00000100:00100000:1.0:1789596894.683245:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789596894.683256:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+17:15778:x1876527964844416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789596894.683563:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+17:15778:x1876527964844416:12345-0@lo:502:mount.lustre.0 Request processed in 308us (7993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596894.683572:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789596894.683783:0:15778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6573b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964844416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789596894.683957:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789596894.683973:0:15778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1789596894.688798:0:15779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789596894.688811:0:15779:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789596894.689028:0:15779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789596894.689035:0:15779:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789596894.689114:0:15779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789596894.689130:0:15779:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ea8ffa84d40) 00000020:00000080:2.0:1789596894.689152:0:15779:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789596894.689161:0:15779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789596894.689450:0:15779:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ea8f9e94000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789596894.689465:0:15779:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789596894.689472:0:15779:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8973ae90b38d8bd9 00010000:00010000:3.0:1789596894.699196:0:15779:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1789596894.699603:0:15779:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1789596894.702459:0:15779:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1789596894.706226:0:15779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789596894.706244:0:15779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596894.706251:0:15779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596894.706253:0:15779:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789596894.706257:0:15779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596894.706260:0:15779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596894.706262:0:15779:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789596894.706265:0:15779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789596894.706266:0:15779:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789596894.706269:0:15779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596894.706271:0:15779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596894.706272:0:15779:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789596894.706274:0:15779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789596894.706276:0:15779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596894.706278:0:15779:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789596894.706282:0:15779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789596894.706359:0:15779:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789596894.706363:0:15779:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789596894.706365:0:15779:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789596894.706368:0:15779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1789596894.709921:0:15778:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789596894.709991:0:15778:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789596894.710021:0:15778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d8bc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8bcb expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596894.710036:0:15778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8c0031000/0x8973ae90b38d8bc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8bcb expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596894.710120:0:15778:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea8f9e94000 from 1 10000000:01000000:1.0:1789596894.710123:0:15778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789596894.710160:0:15778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a32600/0x8973ae90b38d8be0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596894.710169:0:15778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a32600/0x8973ae90b38d8be0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596894.710180:0:15778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a32600/0x8973ae90b38d8be0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596894.710205:0:15778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964844544:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789596894.710276:0:15778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596894.710329:0:15778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff5a2840 going to sleep for 11 seconds 00000100:00100000:2.0:1789596894.711758:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964844544 00000100:00100000:2.0:1789596894.711770:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964844544 00000100:00100000:2.0:1789596894.711843:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789596894.711854:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900451050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+17:15778:x1876527964844544:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789596894.711869:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596894.711886:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d8be7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d8be0 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.711911:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d8be7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d8be0 expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.711922:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d8be7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8be0 expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.711930:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426e00, rc 0) 00000100:00100000:2.0:1789596894.711995:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900451050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+18:15778:x1876527964844544:12345-0@lo:101:mount.lustre.0 Request processed in 143us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596894.712002:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789596894.712245:0:15778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964844544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789596894.712262:0:15778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a32600/0x8973ae90b38d8be0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8be7 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596894.712273:0:15778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a32600/0x8973ae90b38d8be0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d8be7 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789596894.720580:0:15778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789596894.726715:0:15778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789596894.727025:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789596894.727070:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789596894.727146:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789596894.727156:0:15778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789596894.727247:0:15778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964844672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789596894.727324:0:15778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596894.727368:0:15778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff5a2840 going to sleep for 11 seconds 00000100:00100000:2.0:1789596894.728164:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964844672 00000100:00100000:2.0:1789596894.728174:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964844672 00000100:00100000:2.0:1789596894.728226:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789596894.728235:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+18:15778:x1876527964844672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789596894.728481:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900452c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+18:15778:x1876527964844672:12345-0@lo:501:mount.lustre.0 Request processed in 246us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596894.728490:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789596894.730974:0:15778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964844672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789596894.731033:0:15778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964844800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789596894.731296:0:15778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596894.732171:0:15778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff5a2840 going to sleep for 11 seconds 00000100:00100000:2.0:1789596894.732553:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964844800 00000100:00100000:2.0:1789596894.732562:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964844800 00000100:00100000:2.0:1789596894.732617:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789596894.732627:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+18:15778:x1876527964844800:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789596894.732938:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900452850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+18:15778:x1876527964844800:12345-0@lo:503:mount.lustre.0 Request processed in 311us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596894.732948:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789596894.733770:0:15778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964844800:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789596894.734783:0:15778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789596894.737968:0:15778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964844928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789596894.738127:0:15778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596894.738214:0:15778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff5a2840 going to sleep for 11 seconds 00000100:00100000:3.0:1789596894.738620:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964844928 00000100:00100000:3.0:1789596894.738629:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964844928 00000100:00100000:3.0:1789596894.738682:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789596894.738693:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900453850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+18:15778:x1876527964844928:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789596894.740064:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900453850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+18:15778:x1876527964844928:12345-0@lo:502:mount.lustre.0 Request processed in 1367us (1931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596894.740076:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789596894.741412:0:15778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964844928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789596894.741671:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789596894.741725:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789596894.741773:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789596894.741811:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789596894.741917:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789596894.741958:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789596894.741986:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789596894.742012:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789596894.742114:0:15778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964845056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789596894.742244:0:15778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596894.742494:0:15778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff5a2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789596894.742539:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964845056 00000100:00100000:0.0:1789596894.742546:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964845056 00000100:00100000:3.0:1789596894.743341:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789596894.743355:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+18:15778:x1876527964845056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596894.743576:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900452450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+18:15778:x1876527964845056:12345-0@lo:502:mount.lustre.0 Request processed in 225us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596894.743584:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789596894.743663:0:15778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964845056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789596894.743797:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789596894.743811:0:15778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789596894.744969:0:15783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596894.744981:0:15783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596894.744984:0:15783:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789596894.744991:0:15783:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ea8f9e94000 00000020:00000080:1.0:1789596894.744993:0:15783:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789596894.745000:0:15783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596894.745002:0:15783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596894.745004:0:15783:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789596894.745006:0:15783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596894.745009:0:15783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596894.745010:0:15783:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789596894.745013:0:15783:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ea8f9e94000 00000020:00000080:1.0:1789596894.745015:0:15783:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789596894.745090:0:15783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596894.745094:0:15783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596894.745095:0:15783:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789596894.745098:0:15783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789596894.745100:0:15783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596894.745101:0:15783:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789596894.745104:0:15783:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ea8f9e94000 00000020:00000080:1.0:1789596894.745106:0:15783:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789596894.745157:0:15783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789596894.745161:0:15783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789596894.745162:0:15783:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789596894.745165:0:15783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789596894.748893:0:15778:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789596894.748945:0:15778:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789596894.748973:0:15778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a32600/0x8973ae90b38d8be0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8be7 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596894.748996:0:15778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a32600/0x8973ae90b38d8be0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8be7 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596894.749074:0:15778:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789596894.749078:0:15778:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ea8f9e94000 10000000:01000000:1.0:1789596894.749081:0:15778:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ea8f9e94000 10000000:01000000:1.0:1789596894.749085:0:15778:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789596894.749091:0:15778:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ea8f9e94000 from 1 10000000:01000000:1.0:1789596894.749093:0:15778:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789596894.749139:0:15778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33000/0x8973ae90b38d8bee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596894.749148:0:15778:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33000/0x8973ae90b38d8bee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596894.749159:0:15778:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33000/0x8973ae90b38d8bee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596894.749183:0:15778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964845184:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789596894.749249:0:15778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596894.750408:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964845184 00000100:00100000:2.0:1789596894.750421:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964845184 00000100:00100000:2.0:1789596894.750480:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789596894.750489:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8e0dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+18:15778:x1876527964845184:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789596894.750506:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596894.750523:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8ef426400/0x8973ae90b38d8bf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d8bee expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.750548:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ef426400/0x8973ae90b38d8bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d8bee expref: 19 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.750560:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8ef426400/0x8973ae90b38d8bf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8bee expref: 19 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.750585:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426400, rc 0) 00000100:00100000:2.0:1789596894.750634:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8e0dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:15778:x1876527964845184:12345-0@lo:101:mount.lustre.0 Request processed in 146us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596894.750641:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789596894.753891:0:15778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff5a23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596894.753942:0:15778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964845184:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789596894.753971:0:15778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33000/0x8973ae90b38d8bee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8bf5 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596894.753983:0:15778:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33000/0x8973ae90b38d8bee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d8bf5 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789596894.754768:0:15778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789596894.755530:0:15778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789596894.755799:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789596894.757278:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789596894.758392:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789596894.758482:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789596894.758523:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789596894.758575:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789596894.758611:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789596894.758645:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789596894.758688:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789596894.758720:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789596894.758754:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789596894.758799:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789596894.763336:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789596894.763398:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789596894.763476:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789596894.763514:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789596894.763548:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789596894.763602:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789596894.763640:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789596894.763675:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789596894.763724:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789596894.763758:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789596894.763791:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789596894.763860:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789596894.763895:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789596894.763930:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789596894.763981:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789596894.764018:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789596894.767334:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789596894.767468:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1789596894.767509:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1789596894.767542:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1789596894.767574:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1789596894.767620:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1789596894.767657:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1789596894.767705:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1789596894.767742:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1789596894.767878:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1789596894.767887:0:15778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789596894.767995:0:15778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964845312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789596894.771281:0:15778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596894.771382:0:15778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff5a23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596894.771743:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964845312 00000100:00100000:0.0:1789596894.771753:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964845312 00000100:00100000:0.0:1789596894.771802:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789596894.771812:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8e0df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:15778:x1876527964845312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789596894.772384:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8e0df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:15778:x1876527964845312:12345-0@lo:501:mount.lustre.0 Request processed in 572us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596894.772394:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789596894.772747:0:15778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964845312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789596894.772799:0:15778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964845440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789596894.772875:0:15778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596894.772895:0:15778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff5a23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596894.774251:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964845440 00000100:00100000:0.0:1789596894.774263:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964845440 00000100:00100000:0.0:1789596894.774331:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789596894.774341:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff40f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:15778:x1876527964845440:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789596894.774561:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff40f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:15778:x1876527964845440:12345-0@lo:503:mount.lustre.0 Request processed in 221us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596894.774569:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789596894.775917:0:15778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964845440:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789596894.776651:0:15778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789596894.776731:0:15778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964845568:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789596894.776801:0:15778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596894.776861:0:15778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff5a23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789596894.779201:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964845568 00000100:00100000:0.0:1789596894.779215:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964845568 00000100:00100000:0.0:1789596894.779278:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789596894.779287:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff40fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:15778:x1876527964845568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789596894.779591:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff40fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:15778:x1876527964845568:12345-0@lo:502:mount.lustre.0 Request processed in 304us (2789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596894.779599:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789596894.784430:0:15778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964845568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789596894.784734:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789596894.784812:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789596894.784869:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789596894.784914:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789596894.784943:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789596894.784982:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789596894.785011:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789596894.785036:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789596894.785098:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789596894.785151:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789596894.785189:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789596894.785262:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789596894.785297:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789596894.785342:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789596894.785388:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789596894.785424:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789596894.785459:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789596894.785509:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789596894.785547:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789596894.785583:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789596894.785635:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789596894.785672:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789596894.785706:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789596894.785751:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789596894.785780:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1789596894.785805:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1789596894.785875:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1789596894.785921:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1789596894.785948:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1789596894.785986:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1789596894.786013:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1789596894.786038:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1789596894.786063:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1789596894.786099:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1789596894.786136:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1789596894.786173:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1789596894.786200:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1789596894.786225:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1789596894.786261:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1789596894.786288:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1789596894.786344:0:15778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa446a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964845696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596894.786417:0:15778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596894.786471:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964845696 00000100:00100000:3.0:1789596894.786478:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964845696 00000100:00100000:3.0:1789596894.786518:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789596894.786525:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff40e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:15778:x1876527964845696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789596894.786709:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff40e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:15778:x1876527964845696:12345-0@lo:502:mount.lustre.0 Request processed in 183us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596894.786716:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789596894.786767:0:15778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c9056540 going to sleep for 11 seconds 00000100:00100000:3.0:1789596894.786786:0:15778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa446a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964845696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789596894.786870:0:15778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789596894.786879:0:15778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789596894.796463:0:15788:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789596894.796480:0:15788:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ea8f745b380) 00000020:00000080:3.0:1789596894.796504:0:15788:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1789596894.796574:0:15788:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ea8f9e94000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789596894.796578:0:15788:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ea8f9e94000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789596894.796580:0:15788:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ea8f9e94000 3 00010000:00080000:3.0:1789596894.796612:0:15788:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ea8c4d00800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.144@tcp at head 00010000:00010000:3.0:1789596894.801628:0:15788:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1789596894.801875:0:15788:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789596894.801924:0:15788:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789596894.801939:0:15788:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8973ae90b38d8c03 00000100:00080000:3.0:1789596894.801951:0:15788:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789596894.801963:0:15788:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ea8c4d00800 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:3.0:1789596894.802001:0:15788:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ea8fa446a00 x1876527964845824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789596894.802035:0:15788:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789596894.802092:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789596894.802096:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789596894.802098:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ea8c86d0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789596894.802103:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 475 00000100:00080000:3.0:1789596894.802107:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789596894.802112:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ea8c86d0800 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:3.0:1789596894.802125:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ea8fa446d80 x1876527964846080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789596894.802180:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964846208:0@lo:400:kworker.0 00000100:00100000:3.0:1789596894.802245:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596894.802280:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789596894.802287:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964846336:0@lo:400:kworker.0 00000100:00100000:2.0:1789596894.806653:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876527964845824:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789596894.806755:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596894.806805:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964846080:0@lo:8:kworker.0 00000100:00100000:2.0:1789596894.806852:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596894.806893:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa445500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964845952:0@lo:400:kworker.0 00000100:00100000:2.0:1789596894.806915:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596894.806957:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964846208 00000100:00100000:2.0:1789596894.806966:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964846208 00000100:00100000:2.0:1789596894.807010:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964845824 00000100:00100000:2.0:1789596894.807013:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964845824 00000100:00100000:0.0:1789596894.807024:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964846080 00000100:00100000:2.0:1789596894.807028:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789596894.807028:0:15062:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964846080 00000100:00100000:2.0:1789596894.807037:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964846208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596894.807088:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964846208:12345-0@lo:400:kworker.0 Request processed in 52us (4843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596894.807096:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789596894.807116:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964845952 00000100:00100000:2.0:1789596894.807118:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789596894.807120:0:15062:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964845952 00000100:00100000:2.0:1789596894.807122:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1876527964845824:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789596894.807149:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789596894.807156:0:15062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964845952:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1789596894.807157:0:14378:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000100:00100000:0.0:1789596894.807195:0:15062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6570380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964845952:12345-0@lo:400:kworker.0 Request processed in 40us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596894.807201:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:2.0:1789596894.807206:0:14378:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8973ae90b38d8c0a 00000100:00100000:0.0:1789596894.807213:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789596894.807216:0:15062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876527964846080:12345-0@lo:8:kworker.0 00000004:00100000:2.0:1789596894.807222:0:14378:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1789596894.807251:0:15062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876527964846080:12345-0@lo:8:kworker.0 Request processed in 33us (399us total) trans 0 rc -11/-11 00000100:00080000:2.0:1789596894.807255:0:14378:0:(import.c:65:import_set_state_nolock()) ffff9ea7c2e61000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596894.807264:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789596894.807284:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596894.807286:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876527964845824:12345-0@lo:38:llog_process_th.0 Request processed in 163us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596894.807292:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789596894.807321:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789596894.807337:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa445500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964845952:0@lo:400:kworker.0 00010000:00080000:2.0:1789596894.807409:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8fa446a00 x1876527964845824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789596904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789596894.807418:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789596894.807425:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789596894.807433:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789596894.807438:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789596894.807440:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8c4d00800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789596894.807445:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876527964845824:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789596894.807456:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789596894.807459:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8c86d0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789596894.807464:0:3305:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789596894.807466:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964846080:0@lo:8:kworker.0 00000100:00100000:3.0:1789596894.807495:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789596894.807533:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8fa447480 x1876527964846208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596894.807542:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964846208:0@lo:400:kworker.0 00000100:00100000:0.0:1789596894.808699:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964846336 00000100:00100000:0.0:1789596894.808709:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964846336 00000100:00100000:0.0:1789596894.808760:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789596894.808768:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964846336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596894.808848:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964846336:12345-0@lo:400:kworker.0 Request processed in 81us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596894.808855:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789596894.809451:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789596894.811580:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ea8fa445f80 x1876527964846336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596894.811600:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964846336:0@lo:400:kworker.0 00000040:00080000:3.0:1789596894.812153:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1789596894.814480:0:15778:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789596894.814524:0:15778:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789596894.814550:0:15778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33000/0x8973ae90b38d8bee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8bf5 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596894.814562:0:15778:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33000/0x8973ae90b38d8bee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8bf5 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789596894.814617:0:15778:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789596894.814619:0:15778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789596894.814621:0:15778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789596894.814622:0:15778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789596894.814623:0:15778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789596894.814630:0:15778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789596894.814632:0:15778:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789596894.814633:0:15778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789596894.814635:0:15778:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789596894.814638:0:15778:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789596894.814641:0:15778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789596894.814642:0:15778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789596894.814643:0:15778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789596894.814644:0:15778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789596894.814645:0:15778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789596894.814646:0:15778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789596894.814647:0:15778:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789596894.814648:0:15778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789596894.814649:0:15778:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789596894.814677:0:15778:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789596894.814699:0:15778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964846464:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789596894.814784:0:15778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596894.814863:0:15778:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea900034540 going to sleep for 11 seconds 00000100:00100000:1.0:1789596894.815466:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964846464 00000100:00100000:1.0:1789596894.815477:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964846464 00000100:00100000:1.0:1789596894.815525:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789596894.815535:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ff40c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:15778:x1876527964846464:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789596894.815564:0:14371:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789596894.815584:0:14371:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789596894.874549:0:14371:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789596894.874600:0:14371:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789596894.885792:0:14393:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789596894.885804:0:14393:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789596894.885917:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8c11 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.885938:0:14393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d8aeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8ae4 expref: 19 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.885946:0:14393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8c11 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.885991:0:14393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d8aeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d8ae4 expref: 19 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.886023:0:14393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d8aeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d8ae4 expref: 19 pid: 14371 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596894.886053:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6573b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1876527964846592:0@lo:104: 00000100:00100000:2.0:1789596894.886112:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596894.886298:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ef49de40 going to sleep for 11 seconds 00000100:00100000:0.0:1789596894.887254:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964846592 00000100:00100000:0.0:1789596894.887264:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964846592 00000100:00100000:0.0:1789596894.887324:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789596894.887334:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6573480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+3:14393:x1876527964846592:12345-0@lo:104: 00010000:00010000:0.0:1789596894.887349:0:14360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427400/0x8973ae90b38d8ae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d8aeb expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596894.887411:0:14360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789596894.887417:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6573480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+3:14393:x1876527964846592:12345-0@lo:104: Request processed in 85us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596894.887423:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789596894.889410:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596894.889423:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427400/0x8973ae90b38d8ae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d8aeb expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.889433:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427400 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:2.0:1789596894.889438:0:14365:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427400/0x8973ae90b38d8ae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d8aeb expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.889449:0:14365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427400/0x8973ae90b38d8ae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d8aeb expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789596894.889456:0:14365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427400/0x8973ae90b38d8ae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d8aeb expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596894.889463:0:14365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789596894.889516:0:14365:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427400/0x8973ae90b38d8ae4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8aeb expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.889522:0:14365:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789596894.889558:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427400/0x8973ae90b38d8ae4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8aeb expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.889565:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427400/0x8973ae90b38d8ae4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8aeb expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.889599:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596894.889601:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596894.889602:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596894.889668:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6573b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14393:1876527964846592:0@lo:104: 00010000:00010000:2.0:1789596894.889693:0:14393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8c11 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596894.889745:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789596894.889762:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3309:1876527964846720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789596894.889855:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596894.891208:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964846720 00000100:00100000:2.0:1789596894.891219:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964846720 00010000:00010000:2.0:1789596894.891256:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d8aeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d8ae4 expref: 20 pid: 14371 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596894.891298:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789596894.891316:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa658700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+20:3309:x1876527964846720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596894.891329:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596894.891334:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d8aeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d8ae4 expref: 20 pid: 14371 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.891345:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d8aeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d8ae4 expref: 20 pid: 14371 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.891362:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8d5f89800/0x8973ae90b38d8aeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d8ae4 expref: 20 pid: 14371 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.891377:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8c11 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.891385:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8c11 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789596894.891411:0:14362:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005608101s 00010000:00010000:2.0:1789596894.891416:0:14362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8c11 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.891423:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8c11 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.891429:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8c11 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.891436:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8c11 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.891442:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596894.891446:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8c11 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.891453:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8c11 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.891469:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8c11 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.891480:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596894.891533:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa658700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:3309:x1876527964846720:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (1677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596894.891540:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789596894.891582:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3309:1876527964846720:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789596894.891608:0:14393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8c11 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.891622:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8c11 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596894.891628:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8c11 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596894.907583:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ff40c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+18:15778:x1876527964846464:12345-0@lo:253:mount.lustre.0 Request processed in 92040us (92789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596894.907617:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789596894.907884:0:15778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:725ddb85-e0d3-4aba-b101-0ba8e10978f0:15778:1876527964846464:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789596894.907899:0:15778:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789596894.907902:0:15778:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789596894.907904:0:15778:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789596894.907906:0:15778:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789596894.907907:0:15778:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789596894.907908:0:15778:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789596894.907910:0:15778:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789596894.907911:0:15778:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789596894.907913:0:15778:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789596894.907914:0:15778:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789596894.907930:0:15778:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789596894.930479:0:15778:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789596894.930660:0:15778:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789596894.933284:0:15778:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789596894.933738:0:15778:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789596894.933948:0:15778:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789596894.936722:0:15778:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789596894.945484:0:15778:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789596895.037498:0:15778:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789596895.037508:0:15778:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789596895.037539:0:15778:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789596895.037610:0:15778:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.144@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789596895.037623:0:15778:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789596895.037649:0:15778:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789596895.581858:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596896.288840:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964846848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596896.288916:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596896.289170:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964846848 00000100:00100000:3.0:1789596896.289180:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964846848 00000100:00100000:3.0:1789596896.289236:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789596896.289245:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964846848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596896.289276:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596896.289332:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa659f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964846848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596896.289339:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789596896.289359:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596896.289694:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964846848:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789596896.603039:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789596896.603156:0:14374:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789596896.603161:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ea7c29c1800 from 8 10000000:01000000:2.0:1789596896.603166:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789596896.603212:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427e00/0x8973ae90b38d8c18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596896.603225:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427e00/0x8973ae90b38d8c18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596896.603237:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427e00/0x8973ae90b38d8c18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596896.603263:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964846976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789596896.603341:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596896.603444:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ef49db40 going to sleep for 11 seconds 00000100:00100000:3.0:1789596896.604000:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964846976 00000100:00100000:3.0:1789596896.604007:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964846976 00000100:00100000:0.0:1789596896.604245:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789596896.604256:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d2e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+18:14374:x1876527964846976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596896.604271:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596896.604287:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d8c1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d8c18 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596896.604324:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d8c1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d8c18 expref: 19 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596896.604335:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8c0031a00/0x8973ae90b38d8c1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8c18 expref: 19 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596896.604343:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0031a00, rc 0) 00000100:00100000:0.0:1789596896.604408:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d2e79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:14374:x1876527964846976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596896.604415:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789596896.604495:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964846976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596896.604514:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427e00/0x8973ae90b38d8c18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8c1f expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596896.604536:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427e00/0x8973ae90b38d8c18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d8c1f expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596896.604585:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964847104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789596896.604617:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596896.604778:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ef49db40 going to sleep for 11 seconds 00000100:00100000:1.0:1789596896.605003:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964847104 00000100:00100000:1.0:1789596896.605009:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964847104 00000100:00100000:1.0:1789596896.605042:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789596896.605049:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d2e7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:14374:x1876527964847104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789596896.605065:0:14369:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789596896.605084:0:14369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789596896.605087:0:14369:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789596896.605571:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d2e7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:14374:x1876527964847104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 518us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596896.605581:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789596896.605664:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964847104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789596896.605726:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789596896.605734:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427e00/0x8973ae90b38d8c18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8c1f expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596896.605743:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427e00/0x8973ae90b38d8c18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8c1f expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596897.629915:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789596898.012304:0:14409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789596898.652773:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596899.681058:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789596899.870218:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789596899.870253:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789596899.870269:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ea8c86d0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789596899.870293:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ea8c86d0800 using connection 192.168.202.144@tcp/0@lo 00000100:00100000:0.0:1789596899.870321:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ea8c6ec2a00 x1876527964847488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789596899.870416:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3306:1876527964847232:0@lo:400:kworker.0 00000100:00100000:0.0:1789596899.870511:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596899.870575:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964847872:0@lo:400:kworker.0 00000100:00100000:0.0:1789596899.870615:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596899.870660:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596899.870668:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964847360:0@lo:400:kworker.0 00000100:00100000:0.0:1789596899.870696:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596899.870726:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964847488:0@lo:8:kworker.0 00000100:00100000:0.0:1789596899.870749:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596899.870776:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964847616:0@lo:400:kworker.0 00000100:00100000:0.0:1789596899.870801:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596899.870840:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596899.870846:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964847744:0@lo:400:kworker.0 00000100:00100000:0.0:1789596899.870869:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596899.870919:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964847232 00000100:00100000:0.0:1789596899.870929:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964847232 00000100:00100000:0.0:1789596899.870989:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789596899.871000:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d2e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:3306:x1876527964847232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596899.871063:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d2e78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:3306:x1876527964847232:12345-0@lo:400:kworker.0 Request processed in 64us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596899.871082:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789596899.871125:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964847872 00000100:00100000:0.0:1789596899.871144:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964847872 00000100:00100000:0.0:1789596899.871185:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964847616 00000100:00100000:0.0:1789596899.871190:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964847616 00000100:00100000:0.0:1789596899.871203:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964847744 00000100:00100000:0.0:1789596899.871206:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964847744 00000100:00100000:0.0:1789596899.871222:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789596899.871229:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964847872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596899.871279:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964847872:12345-0@lo:400:kworker.0 Request processed in 50us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596899.871285:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789596899.871302:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789596899.871308:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964847616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596899.871338:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876527964847616:12345-0@lo:400:kworker.0 Request processed in 31us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596899.871343:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789596899.871355:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789596899.871361:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964847744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596899.871386:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876527964847744:12345-0@lo:400:kworker.0 Request processed in 26us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596899.871392:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789596899.871412:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964847360 00000100:00100000:0.0:1789596899.871417:0:15062:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964847360 00000100:00100000:0.0:1789596899.871446:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964847488 00000100:00100000:0.0:1789596899.871449:0:15062:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964847488 00000100:00100000:0.0:1789596899.871461:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789596899.871474:0:15062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964847360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596899.871502:0:15062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964847360:12345-0@lo:400:kworker.0 Request processed in 29us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596899.871506:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789596899.871516:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789596899.871519:0:15062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876527964847488:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789596899.871547:0:15062:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:0.0:1789596899.871590:0:15062:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8973ae90b38d8c26 00002000:00100000:0.0:1789596899.871606:0:15062:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ea8c301e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789596899.871611:0:15062:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789596899.871615:0:15062:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789596899.872093:0:15062:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789596899.872125:0:15062:0:(import.c:65:import_set_state_nolock()) ffff9ea8c301c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596899.872179:0:15062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876527964847488:12345-0@lo:8:kworker.0 Request processed in 657us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596899.872187:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789596899.872232:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789596899.872237:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789596899.872287:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c6ec2a00 x1876527964847488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789596924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789596899.872306:0:3305:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789596899.872317:0:3305:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789596899.872323:0:3305:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789596899.872326:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9ea8c86d0800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789596899.872342:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789596899.872347:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876527964847488:0@lo:8:kworker.0 00000004:00080000:0.0:1789596899.872415:0:14402:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1789596899.872436:0:14402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14402:1876527964848128:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789596899.872469:0:14402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596899.872490:0:14402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff5a26c0 going to sleep for 11 seconds 00000004:00080000:0.0:1789596899.872508:0:14401:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789596899.872915:0:14401:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 484837097593ns, next at 0ns, rc = 0 00010000:00080000:0.0:1789596899.873221:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c6ec0e00 x1876527964847744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596899.873234:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876527964847744:0@lo:400:kworker.0 00010000:00080000:0.0:1789596899.873248:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c6ec2680 x1876527964847616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789596899.873257:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876527964847616:0@lo:400:kworker.0 00000100:00100000:3.0:1789596899.875365:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964848128 00000100:00100000:3.0:1789596899.875384:0:15061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964848128 00000100:00100000:3.0:1789596899.875485:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789596899.875498:0:15061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14402:x1876527964848128:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:0.0:1789596899.884481:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789596899.887896:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964848000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596899.888008:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596899.888219:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964848000 00000100:00100000:3.0:1789596899.888369:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964848000 00000100:00100000:3.0:1789596899.888517:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789596899.888541:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876527964848000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789596899.888590:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596899.890078:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876527964848000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 592us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596899.890100:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789596899.890760:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c6ec2a00 x1876527964848000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789596915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596899.890791:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964848000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596899.894964:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964847360:0@lo:400:kworker.0 00000100:00100000:3.0:1789596899.894986:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3306:1876527964847232:0@lo:400:kworker.0 00010000:00080000:3.0:1789596899.895023:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ea8c6ec1f80 x1876527964847872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789596915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789596899.895036:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964847872:0@lo:400:kworker.0 00002000:00080000:2.0:1789596899.901988:0:15061:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789596899.902006:0:15061:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1789596899.902014:0:15061:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1789596899.945090:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789596899.945113:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000207907e9/0x8973ae90b38d8c2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.945139:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=484s v=(0 0) 00010000:00010000:2.0:1789596899.945152:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596899.945161:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000207907e9/0x8973ae90b38d8c2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.945184:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000207907e9/0x8973ae90b38d8c2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.945197:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000207907e9/0x8973ae90b38d8c2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.945205:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000207907e9/0x8973ae90b38d8c2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.945245:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596899.945272:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596899.945280:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000207907e9/0x8973ae90b38d8c2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.945289:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596899.945296:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000207907e9/0x8973ae90b38d8c2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.945306:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000207907e9/0x8973ae90b38d8c2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.945328:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000207907e9/0x8973ae90b38d8c2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.945347:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000207907e9/0x8973ae90b38d8c2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.945366:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596899.945368:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596899.945370:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789596899.945900:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789596899.945907:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8c34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.945916:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=484s v=(0 0) 00010000:00010000:2.0:1789596899.945920:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596899.945925:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8c34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.945935:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8c34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.945944:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8c34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.945951:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8c34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.945969:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596899.945978:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596899.945988:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8c34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.945996:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef426c00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596899.945999:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8c34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.946007:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8c34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.946019:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8c34 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.946028:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097f0f852/0x8973ae90b38d8c34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.946041:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596899.946043:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596899.946044:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789596899.955140:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789596899.955159:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cf39ff3/0x8973ae90b38d8c3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.955180:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=484s v=(0 0) 00010000:00010000:2.0:1789596899.955186:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596899.955194:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cf39ff3/0x8973ae90b38d8c3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.955237:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cf39ff3/0x8973ae90b38d8c3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.955251:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cf39ff3/0x8973ae90b38d8c3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.955269:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cf39ff3/0x8973ae90b38d8c3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.955302:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789596899.956039:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596899.956048:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cf39ff3/0x8973ae90b38d8c3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.956059:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427000 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:3.0:1789596899.956065:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cf39ff3/0x8973ae90b38d8c3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.956075:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cf39ff3/0x8973ae90b38d8c3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.956117:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cf39ff3/0x8973ae90b38d8c3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.956124:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cf39ff3/0x8973ae90b38d8c3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.956159:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596899.956161:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596899.956163:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789596899.956873:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789596899.956882:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb94917/0x8973ae90b38d8c42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.956895:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=484s v=(0 0) 00010000:00010000:2.0:1789596899.956899:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596899.960338:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eb94917/0x8973ae90b38d8c42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.960371:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eb94917/0x8973ae90b38d8c42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.960386:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb94917/0x8973ae90b38d8c42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.960411:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eb94917/0x8973ae90b38d8c42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.960443:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596899.960473:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596899.960479:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eb94917/0x8973ae90b38d8c42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.960488:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427400 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596899.960494:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb94917/0x8973ae90b38d8c42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.960505:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb94917/0x8973ae90b38d8c42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.960917:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eb94917/0x8973ae90b38d8c42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.960926:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eb94917/0x8973ae90b38d8c42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.960956:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596899.960958:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596899.960960:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789596899.962393:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789596899.962416:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d8c49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.962433:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=484s v=(0 0) 00010000:00010000:2.0:1789596899.962439:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596899.962446:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d8c49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.962463:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d8c49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.962474:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d8c49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.962483:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d8c49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.962510:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596899.962528:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596899.962535:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d8c49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.962545:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596899.962550:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d8c49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.962559:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d8c49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.962584:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d8c49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.962594:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f77422f4/0x8973ae90b38d8c49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.962614:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596899.962616:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596899.962618:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789596899.966758:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596899.966778:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8c50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.966801:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596899.966806:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596899.966841:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8c50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.966860:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8c50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.966873:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8c50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.966881:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8c50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.966943:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789596899.967775:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596899.967783:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8c57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.967792:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596899.967796:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596899.967801:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8c57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.967812:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8c57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.967847:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8c57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.967855:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8c57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.967876:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789596899.968292:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596899.968299:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8c5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.968308:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596899.968317:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596899.968321:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8c5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.968330:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8c5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.968339:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8c5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.968346:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8c5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.968354:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789596899.968741:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596899.968747:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8c65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.968756:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596899.968759:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596899.968763:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8c65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.968774:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8c65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.968783:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8c65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.968795:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8c65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.968803:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789596899.969212:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596899.969217:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8c6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.969226:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596899.969229:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596899.969233:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8c6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.969243:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8c6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.969250:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8c6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.969257:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8c6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.969276:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1789596899.969665:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596899.969671:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8c73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.969687:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596899.969690:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596899.969694:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8c73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.969702:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8c73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.969709:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8c73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.969716:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8c73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.969724:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1789596899.970156:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596899.970163:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.970172:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596899.970175:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596899.970179:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.970190:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.970209:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.970217:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.970225:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1789596899.971351:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789596899.971365:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8c50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971379:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88a00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596899.971384:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8c50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971396:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8c50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971421:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8c50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971430:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8c50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971480:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789596899.971484:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8c57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971496:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88c00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596899.971500:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8c57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971508:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8c57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971518:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8c57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971526:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8c57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971537:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789596899.971541:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8c5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971547:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89400 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596899.971551:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8c5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971569:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8c5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971579:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8c5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971586:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8c5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971598:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789596899.971602:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8c65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971609:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88200 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596899.971612:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8c65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971620:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8c65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971628:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8c65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971634:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8c65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971658:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789596899.971662:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8c6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971669:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89600 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596899.971672:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8c6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971680:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8c6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971690:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8c6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971698:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8c6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971713:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789596899.971718:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8c73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971724:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89c00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596899.971728:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8c73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971747:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8c73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971760:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8c73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971768:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8c73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971782:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596899.971786:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971793:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89e00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596899.971796:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971804:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971843:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971851:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.971876:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596899.971878:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596899.971880:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596899.971889:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789596899.977663:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596899.977682:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.977712:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596899.977718:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596899.977726:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.977745:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.977757:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.977767:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.977807:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596899.978304:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596899.978314:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.978325:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89200 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596899.978331:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.978342:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.978364:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c81 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.978372:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.978393:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596899.978395:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596899.978397:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789596899.979571:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596899.979583:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8c88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.979599:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596899.979604:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596899.979611:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8c88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.979625:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8c88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.979634:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8c88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.979641:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8c88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.979710:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789596899.982660:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596899.982678:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8c8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.982699:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596899.982712:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596899.982720:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8c8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.982739:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8c8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.982749:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8c8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.982757:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8c8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.988155:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789596899.988178:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8c88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.988205:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596899.988212:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8c88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.988226:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8c88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.988256:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8c88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.988292:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8c88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.988327:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596899.988333:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8c8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.988339:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88400 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596899.988342:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8c8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.988350:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8c8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.988360:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8c8f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596899.988374:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596899.988376:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596899.988378:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596899.993244:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789596899.993275:0:15061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8c8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596899.993336:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789596900.003320:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789596900.003403:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596900.003416:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.003439:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596900.003445:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596900.003452:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.003483:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.003496:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.003505:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.003532:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596900.005250:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596900.005275:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.005291:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89200 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596900.005297:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.005309:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.005335:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.005343:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b25d8239/0x8973ae90b38d8c96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.005370:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596900.005372:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596900.005374:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789596900.011320:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596900.011339:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.011364:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596900.011369:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596900.011377:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.011394:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.011405:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.011426:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.011456:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789596900.011480:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789596900.011487:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.011495:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89e00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:3.0:1789596900.011501:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.011511:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.011536:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.011544:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001d42dd2/0x8973ae90b38d8c9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.011565:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596900.011567:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596900.011569:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789596900.013861:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596900.013890:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8ca4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.013910:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596900.013915:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596900.013922:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8ca4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.013940:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8ca4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.013952:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8ca4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.013960:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.016257:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789596900.017292:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789596900.017305:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.017336:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88400 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596900.017342:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.017355:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8ca4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.017380:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8ca4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.017387:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068ddbcdb/0x8973ae90b38d8ca4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596900.017405:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596900.017407:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789596900.017408:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789596900.018546:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596900.018566:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8cab lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.018587:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596900.018592:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596900.018598:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.018616:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.018635:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.018644:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8cab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.018687:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596900.020319:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596900.020332:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8cab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.020346:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89c00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596900.020353:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8cab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.020365:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8cab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.020393:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8cab lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.020406:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d29bf171/0x8973ae90b38d8cab lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.020430:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596900.020432:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596900.020434:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789596900.020757:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596900.020766:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8cb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.020779:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596900.020783:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596900.020790:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.020803:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.020812:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.020844:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.020881:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596900.021094:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596900.021099:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.021106:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89600 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596900.021110:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.021117:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8cb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.021128:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8cb2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.022117:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf35989c/0x8973ae90b38d8cb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.022214:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596900.022217:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596900.022220:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789596900.022810:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596900.026365:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8cb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.026393:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596900.026399:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596900.026407:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.026426:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.026439:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.026447:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8cb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.026483:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789596900.027313:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596900.027323:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8cc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.027336:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596900.027348:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596900.027353:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8cc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.027365:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8cc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.027374:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8cc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.027381:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8cc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.027399:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789596900.027805:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596900.027812:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8cc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.027863:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596900.027866:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596900.027870:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.027880:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.027889:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.027903:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.027911:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789596900.028894:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789596900.028907:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8cb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.028921:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88200 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596900.028928:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8cb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.028939:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8cb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.028963:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8cb9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.028972:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039007549/0x8973ae90b38d8cb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.029013:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789596900.029017:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8cc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.029024:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89400 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596900.029028:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8cc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.029036:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8cc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.029064:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8cc0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.029071:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5028bbe/0x8973ae90b38d8cc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.029085:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596900.029089:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.029096:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88c00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596900.029100:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.029109:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8cc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.029120:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8cc7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.029128:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006085bede/0x8973ae90b38d8cc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.029154:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596900.029156:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596900.029164:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596900.029176:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789596900.030205:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596900.030218:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8cce lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.030233:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596900.030237:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596900.030244:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8cce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.030269:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8cce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.030280:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8cce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.030288:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8cce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.030353:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789596900.030936:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596900.030943:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8cd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.030957:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596900.030960:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596900.030964:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.030977:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.030985:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.031350:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8cd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.031574:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789596900.031584:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8cce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.031592:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f88a00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596900.031597:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8cce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.031606:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8cce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.031627:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8cce lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.031634:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028f77cad/0x8973ae90b38d8cce lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.031654:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596900.031658:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8cd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.031664:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596900.031667:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8cd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.031687:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8cd5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.031698:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8cd5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.031707:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596900.031708:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596900.031710:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596900.034672:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789596900.034690:0:15061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd0ff9c2/0x8973ae90b38d8cd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.035107:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789596900.035766:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596900.035777:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c03c872f/0x8973ae90b38d8cdc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.035795:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596900.035800:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596900.035808:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c03c872f/0x8973ae90b38d8cdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.035866:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c03c872f/0x8973ae90b38d8cdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.035879:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c03c872f/0x8973ae90b38d8cdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.035887:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c03c872f/0x8973ae90b38d8cdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.035909:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789596900.036099:0:14366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596900.036109:0:14366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c03c872f/0x8973ae90b38d8cdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.036119:0:14366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596900.036125:0:14366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c03c872f/0x8973ae90b38d8cdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.036241:0:14366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c03c872f/0x8973ae90b38d8cdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.036274:0:14366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c03c872f/0x8973ae90b38d8cdc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.036283:0:14366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c03c872f/0x8973ae90b38d8cdc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.036317:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596900.036319:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596900.036321:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789596900.037653:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596900.037666:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035c33d07/0x8973ae90b38d8ce3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.037685:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596900.037691:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596900.037698:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035c33d07/0x8973ae90b38d8ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.037714:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035c33d07/0x8973ae90b38d8ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.037725:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035c33d07/0x8973ae90b38d8ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.037747:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035c33d07/0x8973ae90b38d8ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.037864:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789596900.038575:0:15061:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789596900.038582:0:15061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e88b364f/0x8973ae90b38d8cea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.038593:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789596900.038597:0:15061:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596900.038602:0:15061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e88b364f/0x8973ae90b38d8cea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.038612:0:15061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e88b364f/0x8973ae90b38d8cea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.038620:0:15061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e88b364f/0x8973ae90b38d8cea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596900.038627:0:15061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e88b364f/0x8973ae90b38d8cea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.040543:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789596900.040563:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035c33d07/0x8973ae90b38d8ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.040578:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7a00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596900.040583:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035c33d07/0x8973ae90b38d8ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.040595:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035c33d07/0x8973ae90b38d8ce3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.040622:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035c33d07/0x8973ae90b38d8ce3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.040629:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035c33d07/0x8973ae90b38d8ce3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.040653:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596900.040658:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e88b364f/0x8973ae90b38d8cea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.040665:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7600 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596900.040679:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e88b364f/0x8973ae90b38d8cea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.040688:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e88b364f/0x8973ae90b38d8cea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.040699:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e88b364f/0x8973ae90b38d8cea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596900.040709:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596900.040710:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596900.040712:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789596900.045359:0:15061:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789596900.045379:0:15061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e88b364f/0x8973ae90b38d8cea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789596900.045922:0:15061:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00010000:00010000:0.0:1789596900.046107:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596900.046886:0:15061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14402:x1876527964848128:12345-0@lo:5:osp-pre-1-0.0 Request processed in 171384us (174408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596900.046902:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789596900.047224:0:14402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14402:1876527964848128:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789596900.047247:0:14402:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1789596900.047320:0:14402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14402:1876527964848256:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789596900.047374:0:14402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596900.047442:0:14402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8ff5a26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789596900.047674:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964848256 00000100:00100000:2.0:1789596900.047685:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964848256 00000100:00100000:2.0:1789596900.047749:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789596900.047762:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14402:x1876527964848256:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789596900.047840:0:15063:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1789596900.062711:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14402:x1876527964848256:12345-0@lo:5:osp-pre-1-0.0 Request processed in 14937us (15322us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789596900.062729:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789596900.072991:0:14402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14402:1876527964848256:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789596900.073033:0:14402:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:00100000:3.0:1789596900.539672:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789596900.539726:0:7655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:0.0:1789596900.699006:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596901.405382:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964848384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596901.405487:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596901.405603:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964848384 00000100:00100000:1.0:1789596901.405613:0:15065:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964848384 00000100:00100000:1.0:1789596901.405683:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789596901.405694:0:15065:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa65b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964848384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789596901.405738:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789596901.405802:0:15065:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa65b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964848384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596901.405810:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789596901.405880:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596901.405929:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964848384:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789596901.728544:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789596901.852153:0:16135:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg244-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789596902.753137:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596903.771993:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596904.425153:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596904.425256:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944932864 00000100:00100000:3.0:1789596904.425267:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944932864 00000100:00100000:3.0:1789596904.425311:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 73 00000100:00100000:3.0:1789596904.425319:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2350:x1876527944932864:12345-192.168.202.44@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789596904.425347:0:14371:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 92037e76-77c7-46ec-bc5c-4b7881dcad9b@192.168.202.44@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:3.0:1789596904.425379:0:14371:0:(genops.c:1384:class_connect()) connect: client 92037e76-77c7-46ec-bc5c-4b7881dcad9b, cookie 0x8973ae90b38d8cf1 00000100:00080000:3.0:1789596904.425509:0:14371:0:(import.c:65:import_set_state_nolock()) ffff9ea8ff8bc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789596904.425585:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+5:2350:x1876527944932864:12345-192.168.202.44@tcp:250:mount.lustre.0 Request processed in 265us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596904.427393:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 73 00000100:00100000:2.0:1789596904.428442:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596904.428521:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944932992 00000100:00100000:0.0:1789596904.428530:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944932992 00000100:00100000:0.0:1789596904.428632:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 74 00000100:00100000:0.0:1789596904.428657:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92037e76-77c7-46ec-bc5c-4b7881dcad9b+5:13736:x1876527944932992:12345-192.168.202.44@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789596904.428673:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596904.428691:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8c0030e00/0x8973ae90b38d8cf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c34510c expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596904.428720:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c0030e00/0x8973ae90b38d8cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34510c expref: 6 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596904.428732:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8c0030e00/0x8973ae90b38d8cf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34510c expref: 6 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596904.428741:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030e00, rc 0) 00000100:00100000:0.0:1789596904.428795:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92037e76-77c7-46ec-bc5c-4b7881dcad9b+6:13736:x1876527944932992:12345-192.168.202.44@tcp:101:mount.lustre.0 Request processed in 141us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596904.428802:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 74 00000100:00100000:2.0:1789596904.435668:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596904.435855:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944933120 00000100:00100000:0.0:1789596904.435867:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944933120 00000100:00100000:0.0:1789596904.435909:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 75 00000100:00100000:0.0:1789596904.435919:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+6:13736:x1876527944933120:12345-192.168.202.44@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789596904.436637:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+6:13736:x1876527944933120:12345-192.168.202.44@tcp:501:mount.lustre.0 Request processed in 717us (978us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789596904.436647:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 75 00000100:00100000:2.0:1789596904.450751:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596904.450851:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944933248 00000100:00100000:0.0:1789596904.450861:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944933248 00000100:00100000:0.0:1789596904.450916:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 76 00000100:00100000:0.0:1789596904.450926:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92037e76-77c7-46ec-bc5c-4b7881dcad9b+6:13736:x1876527944933248:12345-192.168.202.44@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789596904.450942:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596904.451281:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8c0030c00/0x8973ae90b38d8cff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345113 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596904.451314:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c0030c00/0x8973ae90b38d8cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345113 expref: 7 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596904.451325:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8c0030c00/0x8973ae90b38d8cff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345113 expref: 7 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596904.451335:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030c00, rc 0) 00000100:00100000:0.0:1789596904.451398:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92037e76-77c7-46ec-bc5c-4b7881dcad9b+7:13736:x1876527944933248:12345-192.168.202.44@tcp:101:mount.lustre.0 Request processed in 473us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596904.451404:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 76 00000100:00100000:2.0:1789596904.455439:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596904.455559:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944933376 00000100:00100000:0.0:1789596904.455569:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944933376 00000100:00100000:0.0:1789596904.455812:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 77 00000100:00100000:0.0:1789596904.455857:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+7:13736:x1876527944933376:12345-192.168.202.44@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789596904.456400:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+8:13736:x1876527944933376:12345-192.168.202.44@tcp:501:mount.lustre.0 Request processed in 543us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596904.456408:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 77 00000100:00100000:2.0:1789596904.459925:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596904.461372:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944933504 00000100:00100000:0.0:1789596904.461389:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944933504 00000100:00100000:0.0:1789596904.461513:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 78 00000100:00100000:0.0:1789596904.461524:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92037e76-77c7-46ec-bc5c-4b7881dcad9b+8:13736:x1876527944933504:12345-192.168.202.44@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789596904.462705:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92037e76-77c7-46ec-bc5c-4b7881dcad9b+8:13736:x1876527944933504:12345-192.168.202.44@tcp:503:mount.lustre.0 Request processed in 1174us (2780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596904.462717:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 78 00000100:00100000:2.0:1789596904.467202:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596904.467572:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944933632 00000100:00100000:1.0:1789596904.467583:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944933632 00000100:00100000:1.0:1789596904.467651:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 79 00000100:00100000:1.0:1789596904.467662:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+8:13754:x1876527944933632:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789596904.468555:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+8:13754:x1876527944933632:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 887us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596904.468565:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 79 00000100:00100000:2.0:1789596904.502451:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596904.502552:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944933760 00000100:00100000:1.0:1789596904.502562:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944933760 00000100:00100000:1.0:1789596904.502619:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 80 00000100:00100000:1.0:1789596904.502628:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+8:13754:x1876527944933760:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789596904.502928:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+8:13754:x1876527944933760:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 300us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596904.502938:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 80 00000100:00100000:0.0:1789596904.510481:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596904.512120:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944933888 00000100:00100000:2.0:1789596904.512135:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944933888 00000100:00100000:2.0:1789596904.512204:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 81 00000100:00100000:2.0:1789596904.512213:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+8:13736:x1876527944933888:12345-192.168.202.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789596904.512255:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596904.512273:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8ef426c00/0x8973ae90b38d8d06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c34513d expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596904.512299:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ef426c00/0x8973ae90b38d8d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34513d expref: 9 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596904.512310:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8ef426c00/0x8973ae90b38d8d06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34513d expref: 9 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596904.512318:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426c00, rc 0) 00000100:00100000:2.0:1789596904.512391:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+9:13736:x1876527944933888:12345-192.168.202.44@tcp:101:mount.lustre.0 Request processed in 179us (1919us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596904.512397:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 81 00000100:00100000:2.0:1789596904.527383:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596904.534134:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944934016 00000100:00100000:0.0:1789596904.534149:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944934016 00000100:00100000:0.0:1789596904.534215:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 82 00000100:00100000:0.0:1789596904.534238:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92037e76-77c7-46ec-bc5c-4b7881dcad9b+9:13736:x1876527944934016:12345-192.168.202.44@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789596904.534263:0:14372:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789596904.534286:0:14372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789596904.534291:0:14372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789596904.534294:0:14372:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789596904.534297:0:14372:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789596904.537329:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92037e76-77c7-46ec-bc5c-4b7881dcad9b+9:13736:x1876527944934016:12345-192.168.202.44@tcp:256:mount.lustre.0 Request processed in 3083us (9944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596904.537343:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 82 00000100:00100000:2.0:1789596904.541641:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596904.541722:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944934144 00000100:00100000:1.0:1789596904.541735:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944934144 00000100:00100000:1.0:1789596904.541795:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 83 00000100:00100000:1.0:1789596904.541807:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+9:13736:x1876527944934144:12345-192.168.202.44@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789596904.541863:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596904.541888:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8f6a32000/0x8973ae90b38d8d0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345144 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596904.541915:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8f6a32000/0x8973ae90b38d8d0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345144 expref: 10 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596904.541925:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8f6a32000/0x8973ae90b38d8d0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345144 expref: 10 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596904.541932:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32000, rc 0) 00000100:00100000:1.0:1789596904.541994:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+10:13736:x1876527944934144:12345-192.168.202.44@tcp:101:mount.lustre.0 Request processed in 189us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596904.542001:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 83 00000100:00100000:0.0:1789596904.543961:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596904.544068:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944934272 00000100:00100000:2.0:1789596904.544079:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944934272 00000100:00100000:2.0:1789596904.544135:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 84 00000100:00100000:2.0:1789596904.544145:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92037e76-77c7-46ec-bc5c-4b7881dcad9b+10:13736:x1876527944934272:12345-192.168.202.44@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789596904.544440:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92037e76-77c7-46ec-bc5c-4b7881dcad9b+10:13736:x1876527944934272:12345-192.168.202.44@tcp:501:mount.lustre.0 Request processed in 295us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596904.544448:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 84 00000100:00100000:3.0:1789596904.546575:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596904.547058:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944934400 00000100:00100000:2.0:1789596904.547067:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944934400 00000100:00100000:2.0:1789596904.547111:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 85 00000100:00100000:2.0:1789596904.547121:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+10:13736:x1876527944934400:12345-192.168.202.44@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789596904.547470:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+10:13736:x1876527944934400:12345-192.168.202.44@tcp:503:mount.lustre.0 Request processed in 349us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596904.547479:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 85 00000100:00100000:0.0:1789596904.551524:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596904.552180:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944934528 00000100:00100000:1.0:1789596904.552192:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944934528 00000100:00100000:1.0:1789596904.552264:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 86 00000100:00100000:1.0:1789596904.552275:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+10:13758:x1876527944934528:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789596904.552503:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+10:13758:x1876527944934528:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 229us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596904.552512:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 86 00000100:00100000:0.0:1789596904.565622:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596904.565727:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944934656 00000100:00100000:2.0:1789596904.565750:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944934656 00000100:00100000:2.0:1789596904.565804:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 87 00000100:00100000:2.0:1789596904.565840:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8efb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+10:13758:x1876527944934656:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789596904.566120:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8efb0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+10:13758:x1876527944934656:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 306us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596904.566128:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 87 00000100:00100000:2.0:1789596904.580280:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596904.580368:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944934784 00000100:00100000:0.0:1789596904.580379:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944934784 00000100:00100000:0.0:1789596904.580436:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 4 00000100:00100000:0.0:1789596904.580446:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2350:x1876527944934784:12345-192.168.202.44@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789596904.580476:0:14377:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 46d2bae8-7b02-42fb-8d03-bd9a4d260687@192.168.202.44@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:0.0:1789596904.580529:0:14377:0:(genops.c:1384:class_connect()) connect: client 46d2bae8-7b02-42fb-8d03-bd9a4d260687, cookie 0x8973ae90b38d8d14 00000004:00100000:0.0:1789596904.580559:0:14377:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1789596904.580565:0:14377:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1789596904.652349:0:14377:0:(import.c:65:import_set_state_nolock()) ffff9ea7c2e65000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789596904.652432:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:2350:x1876527944934784:12345-192.168.202.44@tcp:38:mount.lustre.0 Request processed in 71985us (72159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596904.652459:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 4 00000100:00100000:0.0:1789596904.656376:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596904.656422:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596904.656519:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944935040 00000100:00100000:1.0:1789596904.656529:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944935040 00000100:00100000:1.0:1789596904.656594:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944934912 00000100:00100000:1.0:1789596904.656597:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944934912 00000100:00100000:1.0:1789596904.656613:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 5 00000100:00100000:1.0:1789596904.656623:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+7:13736:x1876527944935040:12345-192.168.202.44@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789596904.656663:0:14378:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789596904.656745:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+7:13736:x1876527944935040:12345-192.168.202.44@tcp:41:mount.lustre.0 Request processed in 122us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596904.656765:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 5 00000100:00100000:1.0:1789596904.656783:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 6 00000100:00100000:1.0:1789596904.656789:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:0:x1876527944934912:12345-192.168.202.44@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789596904.656799:0:14378:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789596904.656846:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:0:x1876527944934912:12345-192.168.202.44@tcp:41:mount.lustre.0 Request processed in 57us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596904.656853:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 6 00000100:00080000:0.0:1789596904.657505:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596904.659264:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596904.659362:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944935168 00000100:00100000:1.0:1789596904.659372:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944935168 00000100:00100000:1.0:1789596904.659425:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 7 00000100:00100000:1.0:1789596904.659435:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:13736:x1876527944935168:12345-192.168.202.44@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789596904.659545:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:13736:x1876527944935168:12345-192.168.202.44@tcp:40:mount.lustre.0 Request processed in 111us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596904.659554:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 7 00000100:00100000:1.0:1789596904.666550:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596904.666868:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596904.667122:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596904.667248:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944935552 00000100:00100000:2.0:1789596904.667257:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944935552 00000100:00100000:2.0:1789596904.667312:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 0 00000100:00100000:2.0:1789596904.667325:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:13736:x1876527944935552:12345-192.168.202.44@tcp:33:mount.lustre.0 00000100:00100000:3.0:1789596904.667895:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944935296 00000100:00100000:3.0:1789596904.667900:0:15061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944935296 00000100:00100000:0.0:1789596904.669066:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944935424 00000100:00100000:0.0:1789596904.669075:0:15062:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944935424 00000100:00100000:0.0:1789596904.669114:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 8 00000100:00100000:0.0:1789596904.669127:0:15062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1876527944935424:12345-192.168.202.44@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789596904.669155:0:15062:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 46d2bae8-7b02-42fb-8d03-bd9a4d260687@192.168.202.44@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:0.0:1789596904.669180:0:15062:0:(genops.c:1384:class_connect()) connect: client 46d2bae8-7b02-42fb-8d03-bd9a4d260687, cookie 0x8973ae90b38d8d1b 00002000:00100000:0.0:1789596904.669190:0:15062:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 46d2bae8-7b02-42fb-8d03-bd9a4d260687/ffff9ea8c3018800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789596904.669213:0:15062:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789596904.669523:0:15062:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789596904.669554:0:15062:0:(import.c:65:import_set_state_nolock()) ffff9ea8c3018000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596904.670070:0:15062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:2350:x1876527944935424:12345-192.168.202.44@tcp:8:mount.lustre.0 Request processed in 941us (3201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596904.670079:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 8 00000100:00100000:0.0:1789596904.670134:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 9 00000100:00100000:0.0:1789596904.670139:0:15061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa65aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1876527944935296:12345-192.168.202.44@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789596904.670156:0:15061:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 46d2bae8-7b02-42fb-8d03-bd9a4d260687@192.168.202.44@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:0.0:1789596904.670176:0:15061:0:(genops.c:1384:class_connect()) connect: client 46d2bae8-7b02-42fb-8d03-bd9a4d260687, cookie 0x8973ae90b38d8d22 00002000:00100000:0.0:1789596904.670183:0:15061:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 46d2bae8-7b02-42fb-8d03-bd9a4d260687/ffff9ea8c301b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789596904.670198:0:15061:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789596904.670422:0:15061:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789596904.670442:0:15061:0:(import.c:65:import_set_state_nolock()) ffff9ea8c301d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596904.670470:0:15061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa65aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:2350:x1876527944935296:12345-192.168.202.44@tcp:8:mount.lustre.0 Request processed in 329us (3929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596904.670477:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 9 00000004:00080000:3.0:1789596904.673288:0:14380:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5892us 00000004:00200000:3.0:1789596904.700324:0:14380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789596904.700445:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa65bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:13736:x1876527944935552:12345-192.168.202.44@tcp:33:mount.lustre.0 Request processed in 33119us (33319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596904.700472:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 0 00010000:00010000:0.0:1789596904.797401:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596904.935886:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596904.936151:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944935680 00000100:00100000:2.0:1789596904.936162:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944935680 00000100:00100000:2.0:1789596904.936577:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 8 00000100:00100000:2.0:1789596904.936591:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa65b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:13779:x1876527944935680:12345-192.168.202.44@tcp:101:mkdir.0 00010000:00010000:2.0:1789596904.936613:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596904.936639:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d8d29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c34516e expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596904.936707:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8d30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596904.936720:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8d30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596904.936737:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8d30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596904.936770:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789596904.936774:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789596904.936811:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8d30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596904.936872:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427800/0x8973ae90b38d8d29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34516e expref: 8 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596904.936904:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8d30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34516e expref: 7 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596904.936913:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea700) 00010000:00010000:2.0:1789596904.936916:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789596904.936919:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427000, rc 0) 00000100:00100000:2.0:1789596904.937574:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa65b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+7:13779:x1876527944935680:12345-192.168.202.44@tcp:101:mkdir.0 Request processed in 983us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596904.937583:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 8 00000100:00100000:3.0:1789596904.990101:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596904.990125:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c6ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964848512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789596904.990205:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596904.990683:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964848512 00000100:00100000:0.0:1789596904.990692:0:15065:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964848512 00000100:00100000:0.0:1789596904.990769:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789596904.990778:0:15065:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964848512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596904.990801:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596904.990875:0:15065:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa447480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964848512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596904.990882:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789596904.991196:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3306:1876527964848640:0@lo:400:kworker.0 00000100:00100000:0.0:1789596904.991255:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596904.991290:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964849152:0@lo:400:kworker.0 00000100:00100000:0.0:1789596904.991316:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596904.991335:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596904.991341:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964848768:0@lo:400:kworker.0 00000100:00100000:0.0:1789596904.991364:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596904.991394:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964848768 00000100:00100000:0.0:1789596904.991399:0:15061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964848768 00000100:00100000:0.0:1789596904.991442:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789596904.991450:0:15061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964848768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596904.991488:0:15061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964848768:12345-0@lo:400:kworker.0 Request processed in 38us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596904.991494:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789596904.991536:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964848768:0@lo:400:kworker.0 00000100:00100000:2.0:1789596904.991792:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964848640 00000100:00100000:2.0:1789596904.991798:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964848640 00000100:00100000:2.0:1789596904.991863:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789596904.991872:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:3306:x1876527964848640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596904.991913:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:3306:x1876527964848640:12345-0@lo:400:kworker.0 Request processed in 43us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596904.991920:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789596904.991972:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3306:1876527964848640:0@lo:400:kworker.0 00000100:00100000:1.0:1789596904.992165:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964849024:0@lo:400:kworker.0 00000100:00100000:1.0:1789596904.992211:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596904.992262:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789596904.992269:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876527964848896:0@lo:400:kworker.0 00000100:00100000:1.0:1789596904.992290:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596904.992327:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964849152 00000100:00100000:1.0:1789596904.992348:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964849152 00000100:00100000:1.0:1789596904.992374:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964849024 00000100:00100000:1.0:1789596904.992377:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964849024 00000100:00100000:1.0:1789596904.992389:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964848896 00000100:00100000:1.0:1789596904.992391:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964848896 00000100:00100000:1.0:1789596904.992403:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789596904.992410:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964849152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596904.992463:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876527964849152:12345-0@lo:400:kworker.0 Request processed in 53us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596904.992470:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789596904.992485:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789596904.992490:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964849024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596904.992521:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa65b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964849024:12345-0@lo:400:kworker.0 Request processed in 31us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596904.992526:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789596904.992540:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789596904.992545:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876527964848896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789596904.992573:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876527964848896:12345-0@lo:400:kworker.0 Request processed in 27us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596904.992578:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789596904.992604:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876527964848896:0@lo:400:kworker.0 00000100:00100000:1.0:1789596904.992614:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964849024:0@lo:400:kworker.0 00000100:00100000:1.0:1789596904.992641:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876527964849152:0@lo:400:kworker.0 00000100:00080000:3.0:1789596904.992977:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789596904.992983:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789596904.992987:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789596904.993007:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789596904.993029:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c6ec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964848512:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1789596905.543642:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 46d2bae8-7b02-42fb-8d03-bd9a4d260687 00010000:00010000:1.0:1789596905.819083:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596906.528659:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789596906.528685:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964849280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789596906.528755:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596906.528857:0:15065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964849280 00000100:00100000:2.0:1789596906.528865:0:15065:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964849280 00000100:00100000:2.0:1789596906.528917:0:15065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789596906.528934:0:15065:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964849280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789596906.528966:0:15065:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789596906.529077:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596906.533109:0:15065:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964849280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4175us (4346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596906.533122:0:15065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789596906.533960:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964849280:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1789596906.575606:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 46d2bae8-7b02-42fb-8d03-bd9a4d260687 00010000:00010000:0.0:1789596906.843274:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596907.240069:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596907.240321:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944935808 00000100:00100000:1.0:1789596907.240334:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944935808 00000100:00100000:1.0:1789596907.240482:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 9 00000100:00100000:1.0:1789596907.240497:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+7:13832:x1876527944935808:12345-192.168.202.44@tcp:41:lfs.0 00000004:00000024:1.0:1789596907.240558:0:14379:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789596907.240679:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+7:13832:x1876527944935808:12345-192.168.202.44@tcp:41:lfs.0 Request processed in 185us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596907.240687:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 9 00000100:00080000:3.0:1789596907.240757:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596907.246362:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596907.246550:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944935936 00000100:00100000:1.0:1789596907.246564:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944935936 00000100:00100000:1.0:1789596907.246709:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 6 00000100:00100000:1.0:1789596907.246727:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:13832:x1876527944935936:12345-192.168.202.44@tcp:13:lfs.0 00002000:00000024:1.0:1789596907.246762:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789596907.246903:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:13832:x1876527944935936:12345-192.168.202.44@tcp:13:lfs.0 Request processed in 183us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596907.246912:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 6 00000100:00080000:3.0:1789596907.247909:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596907.250730:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596907.250864:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944936064 00000100:00100000:1.0:1789596907.250878:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944936064 00000100:00100000:1.0:1789596907.251028:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 7 00000100:00100000:1.0:1789596907.251041:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:13832:x1876527944936064:12345-192.168.202.44@tcp:13:lfs.0 00002000:00000024:1.0:1789596907.251095:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789596907.251245:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:13832:x1876527944936064:12345-192.168.202.44@tcp:13:lfs.0 Request processed in 207us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596907.251253:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 7 00000100:00080000:3.0:1789596907.252349:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789596907.524890:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596907.525352:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944936192 00000100:00100000:2.0:1789596907.525363:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944936192 00000100:00100000:2.0:1789596907.525422:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 89 00000100:00100000:2.0:1789596907.525432:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+10:13864:x1876527944936192:12345-192.168.202.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789596907.525448:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596907.525468:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8d37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345175 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596907.525498:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345175 expref: 11 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596907.525509:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8ef427800/0x8973ae90b38d8d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345175 expref: 11 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596907.525517:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427800, rc 0) 00000100:00100000:2.0:1789596907.525577:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ecd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+11:13864:x1876527944936192:12345-192.168.202.44@tcp:101:mount.lustre.0 Request processed in 147us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596907.525585:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 89 00000100:00100000:0.0:1789596907.533312:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596907.533465:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944936320 00000100:00100000:1.0:1789596907.533503:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944936320 00000100:00100000:1.0:1789596907.533591:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 90 00000100:00100000:1.0:1789596907.533604:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+11:13864:x1876527944936320:12345-192.168.202.44@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789596907.534400:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ece450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+11:13864:x1876527944936320:12345-192.168.202.44@tcp:501:mount.lustre.0 Request processed in 795us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596907.534411:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 90 00000100:00100000:2.0:1789596907.542348:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596907.549564:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944936448 00000100:00100000:0.0:1789596907.549580:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944936448 00000100:00100000:0.0:1789596907.549643:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 91 00000100:00100000:0.0:1789596907.549654:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92037e76-77c7-46ec-bc5c-4b7881dcad9b+11:13864:x1876527944936448:12345-192.168.202.44@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789596907.549969:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92037e76-77c7-46ec-bc5c-4b7881dcad9b+11:13864:x1876527944936448:12345-192.168.202.44@tcp:503:mount.lustre.0 Request processed in 315us (7630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596907.549978:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 91 00000100:00100000:0.0:1789596907.572223:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596907.572662:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944936576 00000100:00100000:1.0:1789596907.572681:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944936576 00000100:00100000:1.0:1789596907.572760:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 92 00000100:00100000:1.0:1789596907.572775:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+11:13871:x1876527944936576:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789596907.573491:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ecec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+11:13871:x1876527944936576:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 718us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596907.573502:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 92 00000100:00100000:1.0:1789596907.602865:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596907.602982:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944936704 00000100:00100000:2.0:1789596907.602992:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944936704 00000100:00100000:2.0:1789596907.603058:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 93 00000100:00100000:2.0:1789596907.603068:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+11:13871:x1876527944936704:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789596907.603485:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ecdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+11:13871:x1876527944936704:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 417us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596907.603501:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 93 00000100:00100000:2.0:1789596907.618787:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596907.619331:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944936832 00000100:00100000:1.0:1789596907.619342:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944936832 00000100:00100000:1.0:1789596907.619402:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 94 00000100:00100000:1.0:1789596907.619411:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6eccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+11:13864:x1876527944936832:12345-192.168.202.44@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789596907.619428:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596907.619447:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8f6a33600/0x8973ae90b38d8d3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c34519f expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596907.619474:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8f6a33600/0x8973ae90b38d8d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34519f expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596907.619486:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8f6a33600/0x8973ae90b38d8d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34519f expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596907.619512:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a33600, rc 0) 00000100:00100000:1.0:1789596907.619576:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6eccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+12:13864:x1876527944936832:12345-192.168.202.44@tcp:101:mount.lustre.0 Request processed in 165us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596907.619582:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 94 00000100:00100000:3.0:1789596907.626346:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596907.626629:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944936960 00000100:00100000:2.0:1789596907.626639:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944936960 00000100:00100000:2.0:1789596907.626693:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 95 00000100:00100000:2.0:1789596907.626703:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+12:13864:x1876527944936960:12345-192.168.202.44@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789596907.626729:0:14369:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789596907.626755:0:14369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789596907.626759:0:14369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789596907.626762:0:14369:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789596907.626764:0:14369:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789596907.628929:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ece850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+12:13864:x1876527944936960:12345-192.168.202.44@tcp:256:mount.lustre.0 Request processed in 2217us (2583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596907.628942:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 95 00000100:00100000:3.0:1789596907.632300:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596907.632565:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944937088 00000100:00100000:0.0:1789596907.632575:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944937088 00000100:00100000:0.0:1789596907.633060:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 96 00000100:00100000:0.0:1789596907.633083:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92037e76-77c7-46ec-bc5c-4b7881dcad9b+12:13864:x1876527944937088:12345-192.168.202.44@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789596907.633100:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596907.633120:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8c0031c00/0x8973ae90b38d8d45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3451a6 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596907.633173:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c0031c00/0x8973ae90b38d8d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451a6 expref: 13 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596907.633186:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8c0031c00/0x8973ae90b38d8d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451a6 expref: 13 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596907.633205:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0031c00, rc 0) 00000100:00100000:0.0:1789596907.633275:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:13864:x1876527944937088:12345-192.168.202.44@tcp:101:mount.lustre.0 Request processed in 204us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596907.633300:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 96 00000100:00100000:3.0:1789596907.635444:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596907.636377:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944937216 00000100:00100000:1.0:1789596907.636390:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944937216 00000100:00100000:1.0:1789596907.636434:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 97 00000100:00100000:1.0:1789596907.636444:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:13864:x1876527944937216:12345-192.168.202.44@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789596907.636932:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:13864:x1876527944937216:12345-192.168.202.44@tcp:501:mount.lustre.0 Request processed in 480us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596907.636941:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 97 00000100:00100000:3.0:1789596907.639411:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596907.639485:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944937344 00000100:00100000:1.0:1789596907.639494:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944937344 00000100:00100000:1.0:1789596907.639547:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 98 00000100:00100000:1.0:1789596907.639558:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:13864:x1876527944937344:12345-192.168.202.44@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789596907.640078:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:13864:x1876527944937344:12345-192.168.202.44@tcp:503:mount.lustre.0 Request processed in 508us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596907.640089:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 98 00000100:00100000:0.0:1789596907.643963:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596907.644099:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944937472 00000100:00100000:2.0:1789596907.644108:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944937472 00000100:00100000:2.0:1789596907.644179:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 99 00000100:00100000:2.0:1789596907.644198:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:13875:x1876527944937472:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789596907.644437:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:13875:x1876527944937472:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 249us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596907.644445:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 99 00000100:00100000:2.0:1789596907.654900:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596907.655294:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944937600 00000100:00100000:3.0:1789596907.655305:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944937600 00000100:00100000:3.0:1789596907.655358:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 100 00000100:00100000:3.0:1789596907.655368:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:13875:x1876527944937600:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789596907.655601:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ecfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:13875:x1876527944937600:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 235us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596907.655610:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 100 00000100:00100000:2.0:1789596907.663966:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596907.664014:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596907.664031:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596907.664068:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596907.664103:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944938240 00000100:00100000:2.0:1789596907.664113:0:15061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944938240 00000100:00100000:1.0:1789596907.664683:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944937728 00000100:00100000:1.0:1789596907.664688:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944937728 00000100:00100000:1.0:1789596907.664718:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944938112 00000100:00100000:1.0:1789596907.664733:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944938112 00000100:00100000:1.0:1789596907.664762:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 14 00000100:00100000:1.0:1789596907.664771:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+7:2352:x1876527944938112:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596907.664875:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+7:2352:x1876527944938112:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 104us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596907.664883:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 14 00000100:00100000:1.0:1789596907.664903:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 10 00000100:00100000:1.0:1789596907.664908:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2350:x1876527944937728:12345-192.168.202.44@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789596907.664945:0:14378:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 2f7ae9ce-878f-4910-aaa3-2f42ff41aa04@192.168.202.44@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:1.0:1789596907.664987:0:14378:0:(genops.c:1384:class_connect()) connect: client 2f7ae9ce-878f-4910-aaa3-2f42ff41aa04, cookie 0x8973ae90b38d8d4c 00000004:00100000:1.0:1789596907.665018:0:14378:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789596907.665144:0:14378:0:(import.c:65:import_set_state_nolock()) ffff9ea7c1392000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789596907.665185:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+6:2350:x1876527944937728:12345-192.168.202.44@tcp:38:mount.lustre.0 Request processed in 274us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596907.665220:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 10 00000100:00100000:2.0:1789596907.666272:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944938368 00000100:00100000:2.0:1789596907.666294:0:15061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944938368 00000100:00100000:2.0:1789596907.666323:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 3 00000100:00100000:2.0:1789596907.666331:0:15061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:2352:x1876527944938240:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596907.666460:0:15062:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789596907.666471:0:15062:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789596907.666572:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 4 00000100:00100000:0.0:1789596907.666580:0:15062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:2352:x1876527944938368:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596907.666714:0:15061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:2352:x1876527944938240:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 383us (2699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596907.666722:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 3 00000100:00100000:0.0:1789596907.673066:0:15062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:2352:x1876527944938368:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 6474us (8984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596907.673082:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 4 00000100:00100000:2.0:1789596907.680636:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596907.680734:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596907.681435:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944937856 00000100:00100000:1.0:1789596907.681447:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944937856 00000100:00100000:1.0:1789596907.681522:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944937984 00000100:00100000:1.0:1789596907.681526:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944937984 00000100:00100000:1.0:1789596907.681549:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 11 00000100:00100000:1.0:1789596907.681559:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+7:0:x1876527944937856:12345-192.168.202.44@tcp:41:mount.lustre.0 00000100:00080000:3.0:1789596907.681786:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1789596907.681886:0:14378:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789596907.682059:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+7:0:x1876527944937856:12345-192.168.202.44@tcp:41:mount.lustre.0 Request processed in 499us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596907.682067:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 11 00000100:00100000:1.0:1789596907.682087:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 12 00000100:00100000:1.0:1789596907.682107:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+6:13864:x1876527944937984:12345-192.168.202.44@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789596907.682120:0:14378:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789596907.683544:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+6:13864:x1876527944937984:12345-192.168.202.44@tcp:41:mount.lustre.0 Request processed in 1429us (2801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596907.683555:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 12 00000100:00100000:3.0:1789596907.685637:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596907.685739:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944938496 00000100:00100000:2.0:1789596907.685749:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944938496 00000100:00100000:2.0:1789596907.685794:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 13 00000100:00100000:2.0:1789596907.685803:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+6:13864:x1876527944938496:12345-192.168.202.44@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789596907.685934:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+6:13864:x1876527944938496:12345-192.168.202.44@tcp:40:mount.lustre.0 Request processed in 131us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596907.685941:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 13 00000100:00100000:1.0:1789596907.689037:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596907.689143:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596907.689518:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944938624 00000100:00100000:0.0:1789596907.689528:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944938624 00000100:00100000:0.0:1789596907.689571:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944938752 00000100:00100000:0.0:1789596907.689574:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944938752 00000100:00100000:0.0:1789596907.689744:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 10 00000100:00100000:0.0:1789596907.689753:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1876527944938624:12345-192.168.202.44@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789596907.689784:0:15063:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 2f7ae9ce-878f-4910-aaa3-2f42ff41aa04@192.168.202.44@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:0.0:1789596907.689851:0:15063:0:(genops.c:1384:class_connect()) connect: client 2f7ae9ce-878f-4910-aaa3-2f42ff41aa04, cookie 0x8973ae90b38d8d53 00002000:00100000:0.0:1789596907.689866:0:15063:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2f7ae9ce-878f-4910-aaa3-2f42ff41aa04/ffff9ea8c358e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789596907.689876:0:15063:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789596907.690238:0:15063:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789596907.690270:0:15063:0:(import.c:65:import_set_state_nolock()) ffff9ea8c358f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596907.690340:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+6:2350:x1876527944938624:12345-192.168.202.44@tcp:8:mount.lustre.0 Request processed in 586us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596907.690348:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 10 00000100:00100000:0.0:1789596907.690373:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 11 00000100:00100000:0.0:1789596907.690392:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa65ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1876527944938752:12345-192.168.202.44@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789596907.690412:0:15063:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 2f7ae9ce-878f-4910-aaa3-2f42ff41aa04@192.168.202.44@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:0.0:1789596907.690433:0:15063:0:(genops.c:1384:class_connect()) connect: client 2f7ae9ce-878f-4910-aaa3-2f42ff41aa04, cookie 0x8973ae90b38d8d5a 00002000:00100000:0.0:1789596907.690439:0:15063:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2f7ae9ce-878f-4910-aaa3-2f42ff41aa04/ffff9ea900076000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789596907.690445:0:15063:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789596907.690572:0:15063:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789596907.690605:0:15063:0:(import.c:65:import_set_state_nolock()) ffff9ea900074000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789596907.690630:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa65ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+6:2350:x1876527944938752:12345-192.168.202.44@tcp:8:mount.lustre.0 Request processed in 238us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596907.690636:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 11 00000100:00100000:3.0:1789596907.696765:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596907.696891:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944938880 00000100:00100000:1.0:1789596907.696900:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944938880 00000100:00100000:1.0:1789596907.696963:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1 00000100:00100000:1.0:1789596907.696973:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+6:13864:x1876527944938880:12345-192.168.202.44@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789596907.697047:0:14381:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789596907.697144:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+6:13864:x1876527944938880:12345-192.168.202.44@tcp:33:mount.lustre.0 Request processed in 172us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596907.697152:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1 00000100:00100000:0.0:1789596907.833342:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596907.833464:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944939008 00000100:00100000:1.0:1789596907.833473:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944939008 00000100:00100000:1.0:1789596907.833538:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 14 00000100:00100000:1.0:1789596907.833549:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+6:13896:x1876527944939008:12345-192.168.202.44@tcp:101:mkdir.0 00010000:00010000:1.0:1789596907.833570:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596907.833609:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8d61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3451d0 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596907.833672:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8d68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596907.833685:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596907.833715:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596907.833753:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789596907.833757:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789596907.833778:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596907.833804:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33c00/0x8973ae90b38d8d61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451d0 expref: 8 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596907.833871:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8d68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451d0 expref: 7 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596907.833881:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea700) 00010000:00010000:1.0:1789596907.833884:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789596907.833888:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a33a00, rc 0) 00000100:00100000:1.0:1789596907.834258:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+7:13896:x1876527944939008:12345-192.168.202.44@tcp:101:mkdir.0 Request processed in 709us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596907.834266:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 14 00010000:00010000:1.0:1789596907.867369:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789596908.251569:0:14409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789596908.891213:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789596909.670199:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2f7ae9ce-878f-4910-aaa3-2f42ff41aa04 00000001:00100000:2.0:1789596909.670221:0:5863:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 46d2bae8-7b02-42fb-8d03-bd9a4d260687 00010000:00010000:1.0:1789596909.915403:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596910.107328:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964849536:0@lo:400:kworker.0 00000100:00100000:0.0:1789596910.107382:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596910.107418:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964850048:0@lo:400:kworker.0 00000100:00100000:0.0:1789596910.107434:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596910.107459:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789596910.107465:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3309:1876527964849408:0@lo:400:kworker.0 00000100:00100000:0.0:1789596910.107491:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596910.107512:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964849920:0@lo:400:kworker.0 00000100:00100000:0.0:1789596910.107527:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596910.107543:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964849664:0@lo:400:kworker.0 00000100:00100000:0.0:1789596910.107556:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596910.107588:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596910.107593:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964849792:0@lo:400:kworker.0 00000100:00100000:0.0:1789596910.107613:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596910.107646:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964850048 00000100:00100000:0.0:1789596910.107653:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964850048 00000100:00100000:0.0:1789596910.107691:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964849920 00000100:00100000:0.0:1789596910.107693:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964849920 00000100:00100000:0.0:1789596910.107701:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964849792 00000100:00100000:0.0:1789596910.107702:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964849792 00000100:00100000:0.0:1789596910.107711:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789596910.107716:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964850048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596910.107754:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964850048:12345-0@lo:400:kworker.0 Request processed in 37us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596910.107759:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789596910.107770:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789596910.107774:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964849920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596910.107789:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876527964849920:12345-0@lo:400:kworker.0 Request processed in 16us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596910.107792:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789596910.107798:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789596910.107801:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964849792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596910.107843:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964849792:12345-0@lo:400:kworker.0 Request processed in 42us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596910.107847:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789596910.107861:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964849408 00000100:00100000:0.0:1789596910.107863:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964849408 00000100:00100000:0.0:1789596910.107879:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789596910.107882:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0c33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:3309:x1876527964849408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596910.107913:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0c33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:3309:x1876527964849408:12345-0@lo:400:kworker.0 Request processed in 29us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596910.107921:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789596910.107970:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef64a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964849792:0@lo:400:kworker.0 00000100:00100000:0.0:1789596910.107994:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3309:1876527964849408:0@lo:400:kworker.0 00000100:00100000:0.0:1789596910.108003:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876527964849920:0@lo:400:kworker.0 00000100:00100000:0.0:1789596910.108011:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964850048:0@lo:400:kworker.0 00000100:00100000:3.0:1789596910.108096:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964849536 00000100:00100000:3.0:1789596910.108101:0:15062:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964849536 00000100:00100000:3.0:1789596910.108132:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964849664 00000100:00100000:3.0:1789596910.108136:0:15062:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964849664 00000100:00100000:3.0:1789596910.108154:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789596910.108161:0:15062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964849536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596910.108211:0:15062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964849536:12345-0@lo:400:kworker.0 Request processed in 50us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596910.108215:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789596910.108224:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789596910.108228:0:15062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964849664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596910.108248:0:15062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964849664:12345-0@lo:400:kworker.0 Request processed in 20us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596910.108252:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789596910.108262:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789596910.108265:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789596910.108267:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789596910.108285:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964849664:0@lo:400:kworker.0 00000100:00100000:3.0:1789596910.108298:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964849536:0@lo:400:kworker.0 00000100:00100000:0.0:1789596910.108365:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789596910.108371:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964850176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596910.108390:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596910.108409:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964850176 00000100:00100000:0.0:1789596910.108412:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964850176 00000100:00100000:0.0:1789596910.108428:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789596910.108431:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964850176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789596910.108459:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596910.108495:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964850176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596910.108502:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789596910.108525:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef64ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964850176:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1789596910.387439:0:16338:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1789596910.669390:0:7655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2f7ae9ce-878f-4910-aaa3-2f42ff41aa04 00010000:00010000:0.0:1789596910.939065:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596911.648102:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964850304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789596911.648193:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596911.648365:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964850304 00000100:00100000:3.0:1789596911.648374:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964850304 00000100:00100000:3.0:1789596911.648430:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789596911.648440:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964850304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596911.648475:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596911.648522:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964850304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596911.648544:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789596911.648989:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964850304:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1789596911.755637:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2f7ae9ce-878f-4910-aaa3-2f42ff41aa04 00010000:00010000:0.0:1789596911.963346:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596912.991690:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789596912.998396:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596912.998449:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596912.998484:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596912.998506:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596912.998534:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596912.998569:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944939392 00000100:00100000:3.0:1789596912.998582:0:15062:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944939392 00000100:00100000:3.0:1789596912.998647:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944939904 00000100:00100000:3.0:1789596912.998651:0:15062:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944939904 00000100:00100000:3.0:1789596912.998678:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 7 00000100:00100000:3.0:1789596912.998690:0:15062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:2354:x1876527944939392:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596912.998781:0:15062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:2354:x1876527944939392:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 93us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596912.998790:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 7 00000100:00100000:3.0:1789596912.998810:0:15062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 8 00000100:00100000:3.0:1789596912.998844:0:15062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+5:2354:x1876527944939904:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596912.998871:0:15062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+5:2354:x1876527944939904:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 55us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596912.998878:0:15062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 8 00000100:00080000:3.0:1789596912.998902:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789596912.998908:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596912.998938:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944939136 00000100:00100000:3.0:1789596912.998942:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944939136 00000100:00100000:3.0:1789596912.998970:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 102 00000100:00100000:3.0:1789596912.998977:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8d0c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:2354:x1876527944939136:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596913.000258:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8d0c31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:2354:x1876527944939136:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 1275us (1802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596913.000269:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 102 00000100:00100000:0.0:1789596913.000440:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944939264 00000100:00100000:0.0:1789596913.000450:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944939264 00000100:00100000:0.0:1789596913.000516:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944939648 00000100:00100000:0.0:1789596913.000520:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944939648 00000100:00100000:0.0:1789596913.000547:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 18 00000100:00100000:0.0:1789596913.000556:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:2353:x1876527944939264:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596913.000590:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:2353:x1876527944939264:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 36us (2209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596913.000597:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 18 00000100:00100000:0.0:1789596913.000614:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 19 00000100:00100000:0.0:1789596913.000621:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+6:2354:x1876527944939648:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596913.000645:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+6:2354:x1876527944939648:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 26us (2138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596913.000651:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 19 00000100:00080000:3.0:1789596913.001190:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596913.003366:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596913.003416:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596913.003452:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944939520 00000100:00100000:2.0:1789596913.003464:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944939520 00000100:00100000:2.0:1789596913.003532:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944939776 00000100:00100000:2.0:1789596913.003536:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944939776 00000100:00100000:2.0:1789596913.003562:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 9 00000100:00100000:2.0:1789596913.003574:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:2353:x1876527944939520:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596913.003675:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:2353:x1876527944939520:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 104us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596913.003684:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 9 00000100:00100000:2.0:1789596913.003703:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 10 00000100:00100000:2.0:1789596913.003709:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+5:2353:x1876527944939776:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596913.003735:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+5:2353:x1876527944939776:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 26us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596913.003741:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 10 00000100:00080000:2.0:1789596913.003758:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789596913.003763:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789596914.016192:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789596914.343787:0:16490:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2f9a7160 20000000:00000080:1.0:1789596914.344146:0:16490:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ea8dd728800 uarg=0000000000000000 20000000:01000000:1.0:1789596914.344202:0:16490:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789596914.344211:0:16490:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789596914.344217:0:16490:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789596914.345238:0:16491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1789596914.345439:0:16490:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789596914.351709:0:16490:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789596914.351857:0:16490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ea8c0031400/0x8973ae90b38d8d6f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.352241:0:16490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8f6a32400/0x8973ae90b38d8a66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8a5f expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.352252:0:16490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8ab3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8aac expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.352260:0:16490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d8be7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8be0 expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.352295:0:16490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8f6a32000/0x8973ae90b38d8d0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345144 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.352304:0:16490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ea8c0031c00/0x8973ae90b38d8d45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451a6 expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.352312:0:16490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ea8c0031400/0x8973ae90b38d8d6f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.352369:0:16490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8c0031c00/0x8973ae90b38d8d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451a6 expref: 12 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.352388:0:16490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ea8c0031c00/0x8973ae90b38d8d45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451a6 expref: 12 pid: 14372 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596914.352405:0:16490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef64a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16490:1876527964850432:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596914.352558:0:16490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8f6a32000/0x8973ae90b38d8d0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345144 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.352567:0:16490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ea8f6a32000/0x8973ae90b38d8d0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345144 expref: 12 pid: 14371 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596914.352576:0:16490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef64b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16490:1876527964850560:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596914.352603:0:16490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d8be7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d8be0 expref: 18 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.352612:0:16490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d8be7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d8be0 expref: 18 pid: 14371 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596914.352633:0:16490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef64bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16490:1876527964850688:0@lo:104: 00000100:00100000:0.0:1789596914.352677:0:16490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789596914.352721:0:16490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8ab3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d8aac expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.352730:0:16490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8ab3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d8aac expref: 18 pid: 14369 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596914.352740:0:16490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef649880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16490:1876527964850816:0@lo:104: 00000100:00100000:0.0:1789596914.352761:0:16490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596914.352799:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964850688 00000100:00100000:0.0:1789596914.352808:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964850688 00000100:00100000:3.0:1789596914.355112:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964850816 00000100:00100000:3.0:1789596914.355148:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964850816 00000100:00100000:3.0:1789596914.355306:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789596914.355320:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef648380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+4:16490:x1876527964850816:12345-0@lo:104: 00010000:00010000:3.0:1789596914.355343:0:14361:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89a00/0x8973ae90b38d8aac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d8ab3 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596914.355451:0:14361:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789596914.355456:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef648380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+4:16490:x1876527964850816:12345-0@lo:104: Request processed in 140us (2695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596914.355462:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789596914.355754:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789596914.355764:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+3:16490:x1876527964850688:12345-0@lo:104: 00010000:00010000:0.0:1789596914.355775:0:14360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a32600/0x8973ae90b38d8be0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d8be7 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.355973:0:14360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789596914.355978:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+3:16490:x1876527964850688:12345-0@lo:104: Request processed in 218us (3303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596914.355983:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789596914.356001:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789596914.356007:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89a00/0x8973ae90b38d8aac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d8ab3 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.356013:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8d5f89a00 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:0.0:1789596914.356017:0:14365:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89a00/0x8973ae90b38d8aac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d8ab3 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.356040:0:14365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89a00/0x8973ae90b38d8aac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d8ab3 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596914.356045:0:14365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89a00/0x8973ae90b38d8aac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d8ab3 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596914.356050:0:14365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789596914.356097:0:14365:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89a00/0x8973ae90b38d8aac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8ab3 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.356104:0:14365:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789596914.356138:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89a00/0x8973ae90b38d8aac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8ab3 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.356147:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8d5f89a00/0x8973ae90b38d8aac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8ab3 expref: -99 pid: 15059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.356163:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596914.356166:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a32600/0x8973ae90b38d8be0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d8be7 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.356172:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32600 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:0.0:1789596914.356174:0:14365:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a32600/0x8973ae90b38d8be0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d8be7 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.356181:0:14365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a32600/0x8973ae90b38d8be0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d8be7 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596914.356188:0:14365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a32600/0x8973ae90b38d8be0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d8be7 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596914.356200:0:14365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789596914.356215:0:14365:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a32600/0x8973ae90b38d8be0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8be7 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.356221:0:14365:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789596914.356228:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a32600/0x8973ae90b38d8be0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8be7 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.356235:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a32600/0x8973ae90b38d8be0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8be7 expref: -99 pid: 15778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.356245:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596914.356247:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596914.356249:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596914.356267:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3309:1876527964851072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789596914.356313:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596914.356355:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596914.356360:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3309:1876527964850944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789596914.356382:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789596914.356432:0:16490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ea8f6a32400/0x8973ae90b38d8a66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8973ae90b38d8a5f expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.356446:0:16490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ea8f6a32400/0x8973ae90b38d8a66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8973ae90b38d8a5f expref: 18 pid: 14369 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596914.356456:0:16490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef64aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16490:1876527964851200:0@lo:104: 00000100:00100000:0.0:1789596914.356479:0:16490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596914.356507:0:14360:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789596914.356521:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964851200 00000100:00100000:0.0:1789596914.356529:0:14360:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964851200 00000100:00100000:0.0:1789596914.356553:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789596914.356557:0:14360:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8e6965c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+3:16490:x1876527964851200:12345-0@lo:104: 00010000:00010000:0.0:1789596914.356564:0:14360:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8a5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d8a66 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.356595:0:14360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789596914.356600:0:14360:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8e6965c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+3:16490:x1876527964851200:12345-0@lo:104: Request processed in 43us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596914.356607:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789596914.356647:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596914.356652:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8a5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8973ae90b38d8a66 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.356658:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427a00 already unused, calling callback (ffffffffc1c17c20) 10000000:00010000:0.0:1789596914.356661:0:14365:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8a5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8973ae90b38d8a66 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.356669:0:14365:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8a5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8973ae90b38d8a66 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789596914.356675:0:14365:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8a5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8973ae90b38d8a66 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789596914.356681:0:14365:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789596914.356695:0:14365:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8a5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8a66 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.356701:0:14365:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789596914.356724:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8a5f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8a66 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.356731:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8a5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8973ae90b38d8a66 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.356747:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596914.356749:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596914.356751:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596914.356758:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789596914.356768:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3307:1876527964851328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789596914.356797:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789596914.357057:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789596914.357090:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964851072 00000100:00100000:1.0:1789596914.357094:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964851072 00010000:00010000:1.0:1789596914.357120:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d8be7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d8be0 expref: 19 pid: 14371 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596914.357146:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964850944 00000100:00100000:1.0:1789596914.357150:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964850944 00010000:00010000:1.0:1789596914.357162:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8ab3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d8aac expref: 20 pid: 14369 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596914.357171:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964851328 00000100:00100000:1.0:1789596914.357173:0:14363:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964851328 00010000:00010000:1.0:1789596914.357182:0:14363:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8f6a32400/0x8973ae90b38d8a66 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d8a5f expref: 21 pid: 14369 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596914.357192:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789596914.357197:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+21:3309:x1876527964851072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789596914.357208:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596914.357213:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d8be7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d8be0 expref: 21 pid: 14371 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596914.357222:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d8be7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d8be0 expref: 21 pid: 14371 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596914.357241:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596914.357279:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+21:3309:x1876527964851072:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596914.357285:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789596914.357298:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789596914.357313:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+20:3309:x1876527964850944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789596914.357321:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596914.357327:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8ab3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d8aac expref: 20 pid: 14369 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596914.357335:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8ab3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d8aac expref: 20 pid: 14369 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596914.357344:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789596914.357364:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+20:3309:x1876527964850944:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596914.357370:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789596914.357382:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789596914.357387:0:14363:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900451850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:3307:x1876527964851328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789596914.357394:0:14363:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596914.357398:0:14363:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8f6a32400/0x8973ae90b38d8a66 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8973ae90b38d8a5f expref: 19 pid: 14369 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596914.357405:0:14363:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8f6a32400/0x8973ae90b38d8a66 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8973ae90b38d8a5f expref: 19 pid: 14369 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596914.357413:0:14363:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596914.359016:0:16490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c69a1300 going to sleep for 11 seconds 00010000:00010000:0.0:1789596914.359076:0:16490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8ef426e00/0x8973ae90b38d8be7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d8be0 expref: 19 pid: 14371 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596914.359098:0:16490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef64bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16490:1876527964850688:0@lo:104: 00010000:00010000:0.0:1789596914.359113:0:16490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8ef427c00/0x8973ae90b38d8ab3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d8aac expref: 18 pid: 14369 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596914.359122:0:16490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef649880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16490:1876527964850816:0@lo:104: 00010000:00010000:0.0:1789596914.359142:0:16490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8f6a32400/0x8973ae90b38d8a66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8973ae90b38d8a5f expref: 17 pid: 14369 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596914.359150:0:16490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef64aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16490:1876527964851200:0@lo:104: 00000100:00100000:0.0:1789596914.359241:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3309:1876527964850944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789596914.359253:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3309:1876527964851072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789596914.359778:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596914.359838:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596914.359860:0:14362:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789596914.359876:0:14362:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789596914.359997:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944940160 00000100:00100000:2.0:1789596914.360004:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944940160 00010000:00010000:2.0:1789596914.360045:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8f6a32000/0x8973ae90b38d8d0d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345144 expref: 13 pid: 14371 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596914.360068:0:14362:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789596914.360073:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944940032 00000100:00100000:2.0:1789596914.360076:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944940032 00010000:00010000:2.0:1789596914.360087:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ea8c0031c00/0x8973ae90b38d8d45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451a6 expref: 14 pid: 14372 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596914.360098:0:14362:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789596914.360108:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 7 00000100:00100000:2.0:1789596914.360146:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5782680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+14:2354:x1876527944940160:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596914.360162:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596914.360169:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8f6a32000/0x8973ae90b38d8d0d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345144 expref: 14 pid: 14371 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596914.360180:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8f6a32000/0x8973ae90b38d8d0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345144 expref: 14 pid: 14371 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596914.360203:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596914.360264:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5782680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+14:2354:x1876527944940160:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 119us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596914.360273:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 7 00000100:00100000:2.0:1789596914.360290:0:14362:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789596914.360296:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 8 00000100:00100000:2.0:1789596914.360302:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5783b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:2354:x1876527944940032:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596914.360309:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596914.360313:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ea8c0031c00/0x8973ae90b38d8d45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451a6 expref: 13 pid: 14372 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596914.360323:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ea8c0031c00/0x8973ae90b38d8d45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451a6 expref: 13 pid: 14372 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596914.360335:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ea8c0031400/0x8973ae90b38d8d6f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596914.360346:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8c0031400/0x8973ae90b38d8d6f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596914.360361:0:14362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8c0031400/0x8973ae90b38d8d6f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596914.360376:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ea8c0031400/0x8973ae90b38d8d6f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596914.360383:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ea8c0031400/0x8973ae90b38d8d6f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596914.360391:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ea8c0031400/0x8973ae90b38d8d6f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596914.360399:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031400 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596914.360405:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ea8c0031400/0x8973ae90b38d8d6f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596914.360415:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ea8c0031400/0x8973ae90b38d8d6f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596914.360425:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ea8c0031400/0x8973ae90b38d8d6f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596914.360437:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596914.360459:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5783b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:2354:x1876527944940032:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 156us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596914.360465:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 8 00010000:00010000:0.0:1789596914.361612:0:16490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8c0031c00/0x8973ae90b38d8d45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451a6 expref: 12 pid: 14372 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596914.361646:0:16490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef64a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16490:1876527964850432:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596914.361659:0:16490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8f6a32000/0x8973ae90b38d8d0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345144 expref: 11 pid: 14371 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596914.361665:0:16490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef64b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16490:1876527964850560:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596914.361697:0:16490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ea8c0031400/0x8973ae90b38d8d6f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.361703:0:16490:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ea8c0031400/0x8973ae90b38d8d6f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.361708:0:16490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ea8c0031400/0x8973ae90b38d8d6f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596914.361712:0:16490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ea8c0031400/0x8973ae90b38d8d6f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596914.363761:0:14363:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900451850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:3307:x1876527964851328:12345-0@lo:103:ldlm_bl.0 Request processed in 6356us (6946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596914.363779:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789596914.374275:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef648380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3307:1876527964851328:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789596915.051601:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596915.227421:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964851456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596915.227523:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596915.227731:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964851456 00000100:00100000:3.0:1789596915.227742:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964851456 00000100:00100000:3.0:1789596915.227862:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789596915.227875:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964851456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789596915.227920:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789596915.228233:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964851712:0@lo:400:kworker.0 00000100:00100000:0.0:1789596915.228274:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596915.228305:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596915.228311:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3309:1876527964851584:0@lo:400:kworker.0 00000100:00100000:0.0:1789596915.228340:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596915.228372:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964851840:0@lo:400:kworker.0 00000100:00100000:0.0:1789596915.228399:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596915.228443:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964851840 00000100:00100000:0.0:1789596915.228460:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964851840 00000100:00100000:0.0:1789596915.228493:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789596915.228500:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964851840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596915.228540:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964851840:12345-0@lo:400:kworker.0 Request processed in 41us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596915.228547:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789596915.228596:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964851840:0@lo:400:kworker.0 00000100:00100000:1.0:1789596915.228756:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789596915.228764:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964852096:0@lo:400:kworker.0 00000100:00100000:1.0:1789596915.228794:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596915.228944:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789596915.228953:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964851968:0@lo:400:kworker.0 00000100:00100000:0.0:1789596915.228978:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596915.228998:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964852096 00000100:00100000:0.0:1789596915.229002:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964852096 00000100:00100000:0.0:1789596915.229022:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964851968 00000100:00100000:0.0:1789596915.229024:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964851968 00000100:00100000:0.0:1789596915.229036:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789596915.229042:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964852096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596915.229070:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964852096:12345-0@lo:400:kworker.0 Request processed in 28us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596915.229075:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789596915.229085:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789596915.229090:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964851968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596915.229116:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964851968:12345-0@lo:400:kworker.0 Request processed in 26us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596915.229132:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789596915.229159:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa65a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964851968:0@lo:400:kworker.0 00000100:00100000:3.0:1789596915.229234:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964851456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1361us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596915.229242:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789596915.229268:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789596915.229274:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789596915.229290:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964851584 00000100:00100000:3.0:1789596915.229294:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964851584 00000100:00100000:3.0:1789596915.229340:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789596915.229347:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:3309:x1876527964851584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596915.229378:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:3309:x1876527964851584:12345-0@lo:400:kworker.0 Request processed in 32us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596915.229384:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789596915.229450:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964851712 00000100:00100000:3.0:1789596915.229455:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964851712 00000100:00100000:3.0:1789596915.229488:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789596915.229494:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964851712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596915.229524:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964851712:12345-0@lo:400:kworker.0 Request processed in 31us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596915.229530:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789596915.229543:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596915.229658:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964852096:0@lo:400:kworker.0 00000100:00100000:1.0:1789596915.229668:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3309:1876527964851584:0@lo:400:kworker.0 00000100:00100000:1.0:1789596915.229678:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964851712:0@lo:400:kworker.0 00000100:00100000:2.0:1789596915.237157:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef64b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964851456:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1789596915.811976:0:14374:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789596915.812006:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea8f9e94000 from 10 10000000:01000000:2.0:1789596915.812013:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789596915.812244:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426800/0x8973ae90b38d8d76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596915.812261:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426800/0x8973ae90b38d8d76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596915.812277:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426800/0x8973ae90b38d8d76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596915.812314:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964852224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789596915.812411:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596915.812517:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c313d840 going to sleep for 11 seconds 00000100:00100000:0.0:1789596915.817334:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964852224 00000100:00100000:0.0:1789596915.817364:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964852224 00000100:00100000:1.0:1789596915.817510:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789596915.817525:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+16:14374:x1876527964852224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596915.817549:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596915.817576:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8f6a33400/0x8973ae90b38d8d7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d8d76 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596915.817610:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8f6a33400/0x8973ae90b38d8d7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d8d76 expref: 17 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596915.817624:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8f6a33400/0x8973ae90b38d8d7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8d76 expref: 17 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596915.817634:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a33400, rc 0) 00000100:00100000:1.0:1789596915.817755:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+17:14374:x1876527964852224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (5343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596915.817762:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789596915.818014:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964852224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789596915.818038:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426800/0x8973ae90b38d8d76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8d7d expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596915.818050:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426800/0x8973ae90b38d8d76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d8d7d expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596915.818244:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef64bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964852352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596915.818286:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596915.818331:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6f08600 going to sleep for 11 seconds 00000100:00100000:3.0:1789596915.818437:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964852352 00000100:00100000:3.0:1789596915.818445:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964852352 00000100:00100000:3.0:1789596915.818480:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789596915.818488:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+17:14374:x1876527964852352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596915.819408:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+17:14374:x1876527964852352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 912us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596915.819421:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789596915.823443:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef64bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964852352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596915.823533:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964852480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596915.823632:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596915.823677:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d0ee70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596915.823930:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964852480 00000100:00100000:3.0:1789596915.823940:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964852480 00000100:00100000:3.0:1789596915.824004:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789596915.824016:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+17:14374:x1876527964852480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789596915.824515:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+17:14374:x1876527964852480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 500us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596915.824524:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789596915.824630:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964852480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789596915.830649:0:16542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789596915.833206:0:14374:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789596915.833269:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789596915.833285:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426800/0x8973ae90b38d8d76 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8d7d expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596915.833302:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8ef426800/0x8973ae90b38d8d76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8d7d expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789596915.833315:0:14374:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789596915.833319:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea8ff34e000 from 10 10000000:01000000:1.0:1789596915.833322:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789596915.833372:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33c00/0x8973ae90b38d8d84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596915.833382:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33c00/0x8973ae90b38d8d84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596915.833396:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33c00/0x8973ae90b38d8d84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596915.833430:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964852608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789596915.833525:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596915.833582:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8d0ee70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596915.836500:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964852608 00000100:00100000:3.0:1789596915.836519:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964852608 00000100:00100000:3.0:1789596915.836668:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789596915.836681:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+17:14374:x1876527964852608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596915.836702:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596915.836727:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8ff4e7600/0x8973ae90b38d8d8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d8d84 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596915.836762:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ff4e7600/0x8973ae90b38d8d8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d8d84 expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596915.836775:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8ff4e7600/0x8973ae90b38d8d8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8d84 expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596915.836785:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ff4e7600, rc 0) 00000100:00100000:3.0:1789596915.836921:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+18:14374:x1876527964852608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 243us (3396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596915.836929:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789596915.837011:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37a9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964852608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596915.837035:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33c00/0x8973ae90b38d8d84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8d8b expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596915.837046:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33c00/0x8973ae90b38d8d84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d8d8b expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596915.837257:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964852736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596915.837295:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596915.837343:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964852736 00000100:00100000:3.0:1789596915.837348:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964852736 00000100:00100000:3.0:1789596915.837372:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789596915.837379:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+18:14374:x1876527964852736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596915.837696:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+18:14374:x1876527964852736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 316us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596915.837704:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789596915.837745:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f0377c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789596915.837758:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964852736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789596915.837790:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964852864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596915.844506:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596915.844575:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8f0377c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789596915.844656:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964852864 00000100:00100000:3.0:1789596915.844669:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964852864 00000100:00100000:3.0:1789596915.844744:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789596915.844755:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+18:14374:x1876527964852864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789596915.845282:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+18:14374:x1876527964852864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 526us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596915.845291:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789596915.845510:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964852864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789596915.846600:0:16543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789596915.851085:0:14374:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789596915.851155:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789596915.851172:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33c00/0x8973ae90b38d8d84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8d8b expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596915.851188:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8f6a33c00/0x8973ae90b38d8d84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8d8b expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789596915.851335:0:14374:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789596915.851339:0:14374:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ea7c29c1800 from 10 10000000:01000000:2.0:1789596915.851343:0:14374:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789596915.851395:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8d92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596915.851406:0:14374:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8d92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596915.851440:0:14374:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8d92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596915.851474:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5780e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964852992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789596915.851565:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596915.851628:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c313d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596915.851757:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964852992 00000100:00100000:1.0:1789596915.851767:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964852992 00000100:00100000:1.0:1789596915.851867:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789596915.851880:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+18:14374:x1876527964852992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789596915.851897:0:14372:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596915.851921:0:14372:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8f6a32400/0x8973ae90b38d8d99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8973ae90b38d8d92 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596915.851951:0:14372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8f6a32400/0x8973ae90b38d8d99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8973ae90b38d8d92 expref: 19 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596915.851963:0:14372:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8f6a32400/0x8973ae90b38d8d99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8973ae90b38d8d92 expref: 19 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596915.851972:0:14372:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32400, rc 0) 00000100:00100000:1.0:1789596915.852021:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:14374:x1876527964852992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596915.852028:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789596915.854264:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5780e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964852992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789596915.854304:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8d92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8d99 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596915.854321:0:14374:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8d92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8973ae90b38d8d99 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596915.854451:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5780e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964853120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596915.854522:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596915.854676:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c313d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596915.858012:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964853120 00000100:00100000:1.0:1789596915.858037:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964853120 00000100:00100000:1.0:1789596915.858992:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789596915.859011:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:14374:x1876527964853120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596915.860349:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:14374:x1876527964853120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1327us (5809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596915.860367:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789596915.860715:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5780e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964853120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789596915.860808:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c5780e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964853248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596915.861216:0:14374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596915.861265:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c313d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596915.861721:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964853248 00000100:00100000:1.0:1789596915.861732:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964853248 00000100:00100000:1.0:1789596915.863057:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789596915.863227:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:14374:x1876527964853248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789596915.863570:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:14374:x1876527964853248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 499us (2353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596915.863580:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789596915.863705:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c5780e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:725ddb85-e0d3-4aba-b101-0ba8e10978f0:14374:1876527964853248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789596915.867301:0:16545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789596915.881370:0:14374:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789596915.881428:0:14374:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789596915.881443:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8d92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8d99 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596915.881461:0:14374:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff9ea8ef427a00/0x8973ae90b38d8d92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8973ae90b38d8d99 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596916.065411:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596916.205437:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596916.205525:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944940288 00000100:00100000:3.0:1789596916.205538:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944940288 00000100:00100000:3.0:1789596916.205608:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 113 00000100:00100000:3.0:1789596916.205621:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+11:13750:x1876527944940288:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596916.205644:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596916.205670:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8ff4e6600/0x8973ae90b38d8da0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3451d7 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596916.205707:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ff4e6600/0x8973ae90b38d8da0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451d7 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596916.205721:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8ff4e6600/0x8973ae90b38d8da0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451d7 expref: 12 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596916.205732:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ff4e6600, rc 0) 00000100:00100000:3.0:1789596916.205863:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+12:13750:x1876527944940288:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 244us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596916.205872:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 113 00000100:00100000:3.0:1789596916.210245:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596916.211719:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944940416 00000100:00100000:1.0:1789596916.211738:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944940416 00000100:00100000:1.0:1789596916.211800:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 114 00000100:00100000:1.0:1789596916.211812:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+12:13750:x1876527944940416:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789596916.212234:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+12:13750:x1876527944940416:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 422us (2002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596916.212244:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 114 00000100:00100000:1.0:1789596916.215777:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596916.215946:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944940544 00000100:00100000:0.0:1789596916.215959:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944940544 00000100:00100000:0.0:1789596916.216067:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 115 00000100:00100000:0.0:1789596916.216093:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92037e76-77c7-46ec-bc5c-4b7881dcad9b+12:13750:x1876527944940544:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789596916.216394:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92037e76-77c7-46ec-bc5c-4b7881dcad9b+12:13750:x1876527944940544:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 302us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596916.216413:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 115 00000100:00100000:0.0:1789596916.226966:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596916.227310:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944940672 00000100:00100000:3.0:1789596916.227324:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944940672 00000100:00100000:3.0:1789596916.227395:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 116 00000100:00100000:3.0:1789596916.227407:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+12:13750:x1876527944940672:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789596916.227427:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596916.227452:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ea8ff4e7800/0x8973ae90b38d8da7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3451de expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596916.227502:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ea8ff4e7800/0x8973ae90b38d8da7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451de expref: 13 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596916.227516:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ea8ff4e7800/0x8973ae90b38d8da7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451de expref: 13 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596916.227526:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ff4e7800, rc 0) 00000100:00100000:3.0:1789596916.227600:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:13750:x1876527944940672:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 195us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596916.227607:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 116 00000100:00100000:3.0:1789596916.232024:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596916.232170:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944940800 00000100:00100000:0.0:1789596916.232183:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944940800 00000100:00100000:0.0:1789596916.232252:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 117 00000100:00100000:0.0:1789596916.232264:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:13750:x1876527944940800:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789596916.232633:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:13750:x1876527944940800:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 371us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596916.232653:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 117 00000100:00100000:3.0:1789596916.235184:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596916.235865:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944940928 00000100:00100000:2.0:1789596916.235881:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944940928 00000100:00100000:2.0:1789596916.235946:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 118 00000100:00100000:2.0:1789596916.235957:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f9ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:13750:x1876527944940928:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789596916.236273:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f9ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:13750:x1876527944940928:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 316us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596916.236282:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 118 00000100:00100000:3.0:1789596916.763796:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789596916.763852:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964853376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789596916.763949:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596916.764027:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964853376 00000100:00100000:3.0:1789596916.764038:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964853376 00000100:00100000:3.0:1789596916.764098:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789596916.764124:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964853376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596916.764166:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596916.764231:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa445880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964853376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596916.764238:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789596916.764301:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964853376:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789596917.086763:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596918.107181:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596918.127153:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596918.127213:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596918.127250:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596918.127284:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596918.127313:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596918.127333:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596918.127401:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944941056 00000100:00100000:3.0:1789596918.127434:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944941056 00000100:00100000:1.0:1789596918.127502:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944941312 00000100:00100000:3.0:1789596918.127504:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 119 00000100:00100000:1.0:1789596918.127507:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944941312 00000100:00100000:3.0:1789596918.127515:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900450c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:2351:x1876527944941056:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596918.127552:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944941440 00000100:00100000:1.0:1789596918.127555:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944941440 00000100:00100000:1.0:1789596918.127568:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944941696 00000100:00100000:1.0:1789596918.127570:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944941696 00000100:00100000:1.0:1789596918.127584:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 12 00000100:00100000:1.0:1789596918.127590:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:2351:x1876527944941312:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789596918.127705:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944941184 00000100:00100000:0.0:1789596918.127710:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944941184 00000100:00100000:0.0:1789596918.127746:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944941568 00000100:00100000:0.0:1789596918.127750:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944941568 00000100:00100000:0.0:1789596918.127767:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 23 00000100:00100000:0.0:1789596918.127773:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:2351:x1876527944941184:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596918.128294:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900450c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:2351:x1876527944941056:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 778us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596918.128304:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 119 00000100:00080000:3.0:1789596918.128355:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789596918.128362:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789596918.128365:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789596918.128382:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 13 00000100:00100000:3.0:1789596918.128391:0:15061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:2351:x1876527944941440:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596918.128429:0:15061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:2351:x1876527944941440:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 41us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596918.128436:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 13 00000100:00100000:3.0:1789596918.128451:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 14 00000100:00100000:3.0:1789596918.128458:0:15061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+5:2351:x1876527944941696:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596918.128482:0:15061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+5:2351:x1876527944941696:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 25us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596918.128488:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 14 00000100:00100000:3.0:1789596918.130602:0:14379:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789596918.130636:0:14379:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789596918.130720:0:14377:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789596918.130744:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 24 00000100:00100000:3.0:1789596918.130761:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+6:2351:x1876527944941568:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789596918.130885:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+6:2351:x1876527944941568:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 130us (3570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596918.130915:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 24 00000100:00100000:2.0:1789596918.133791:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596918.133861:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944941824 00000100:00100000:2.0:1789596918.133874:0:15061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944941824 00000100:00100000:2.0:1789596918.133946:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 15 00000100:00100000:2.0:1789596918.133958:0:15061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+5:2351:x1876527944941824:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596918.134051:0:15061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+5:2351:x1876527944941824:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 96us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596918.134060:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 15 00000100:00080000:2.0:1789596918.134084:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789596918.140679:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:2351:x1876527944941312:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 13047us (13386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596918.140728:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 12 00000100:00100000:0.0:1789596918.141337:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:2351:x1876527944941184:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 13559us (14119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596918.141582:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 23 00000040:00080000:1.0:1789596918.491939:0:14409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789596918.684410:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596918.684510:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944941952 00000100:00100000:3.0:1789596918.684524:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944941952 00000100:00100000:3.0:1789596918.684606:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 15 00000100:00100000:3.0:1789596918.684620:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:14406:x1876527944941952:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789596918.684646:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596918.684678:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d8dae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3451e5 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.684763:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8db5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.684782:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8db5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.684795:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8db5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.684812:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8dbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.684848:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.684855:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685557:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d8dc3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685582:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d8dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685590:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d8dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596918.685627:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789596918.685631:0:14377:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789596918.685678:0:14377:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d8dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685691:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8db5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685699:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8db5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685707:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8db5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685713:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596918.685718:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8db5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685726:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8db5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685740:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea700) 00010000:00010000:3.0:1789596918.685743:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596918.685749:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8db5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685766:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8db5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685781:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685787:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8dbc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685792:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8dbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685797:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6a00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596918.685800:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8dbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685806:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8dbc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685813:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ea8d55e5600) 00010000:00010000:3.0:1789596918.685881:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596918.685885:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8dbc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685892:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8dbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685956:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d8dae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451e5 expref: 8 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685988:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6000/0x8973ae90b38d8dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451e5 expref: 7 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.685996:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ea8d55e5b00) 00010000:00010000:3.0:1789596918.685998:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789596918.686001:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ff4e6000, rc 0) 00000100:00100000:3.0:1789596918.690936:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+7:14406:x1876527944941952:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 6290us (6512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596918.690955:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 15 00000100:00100000:3.0:1789596918.704946:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596918.706340:0:16605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944942208 00000100:00100000:1.0:1789596918.706372:0:16605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944942208 00000100:00100000:1.0:1789596918.706533:0:16605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 16 00000100:00100000:1.0:1789596918.706547:0:16605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+7:14406:x1876527944942208:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789596918.706575:0:16605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596918.706602:0:16605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8dca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3451ec expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.706737:0:16605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8dd1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.706757:0:16605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.706773:0:16605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.706793:0:16605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8dd8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.706802:0:16605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.706809:0:16605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.707911:0:16605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d8ddf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.707927:0:16605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d8ddf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.708062:0:16605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d8ddf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596918.708078:0:16605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789596918.711808:0:16605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.711877:0:16605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8dd1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.711887:0:16605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.711894:0:16605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a33200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596918.711900:0:16605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.711909:0:16605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8dd1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.711932:0:16605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ea8d55e5b00) 00010000:00010000:1.0:1789596918.711935:0:16605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596918.711943:0:16605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8dd1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.711950:0:16605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8dd1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.711969:0:16605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.711975:0:16605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8dd8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.711982:0:16605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.711987:0:16605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32a00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596918.711997:0:16605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.712005:0:16605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8dd8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.712014:0:16605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ea8c36d5000) 00010000:00010000:1.0:1789596918.712017:0:16605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596918.712021:0:16605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8dd8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.712027:0:16605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8dd8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.712884:0:16605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8dca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451ec expref: 10 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.712908:0:16605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33800/0x8973ae90b38d8ddf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451ec expref: 9 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.712915:0:16605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:1.0:1789596918.712918:0:16605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596918.712920:0:16605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a33800, rc 0) 00000100:00100000:1.0:1789596918.713010:0:16605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+9:14406:x1876527944942208:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 6465us (8080us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789596918.713020:0:16605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 16 00000100:00100000:2.0:1789596918.717736:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596918.717871:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944942336 00000100:00100000:3.0:1789596918.717887:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944942336 00000100:00100000:3.0:1789596918.718478:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 17 00000100:00100000:3.0:1789596918.718493:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+9:14406:x1876527944942336:12345-192.168.202.44@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789596918.719736:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+9:14406:x1876527944942336:12345-192.168.202.44@tcp:59:lhsmtool_posix.0 Request processed in 1237us (2004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596918.719751:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 17 00000100:00100000:2.0:1789596918.804238:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596918.804552:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944942464 00000100:00100000:0.0:1789596918.804567:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944942464 00000100:00100000:0.0:1789596918.804650:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 18 00000100:00100000:0.0:1789596918.804663:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+9:14412:x1876527944942464:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789596918.804692:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596918.804723:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8ded lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3451f3 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.804807:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d8df4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.804870:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d8df4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.804887:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d8df4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.804928:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8dfb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.804936:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8dfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.804943:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8dfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.807337:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d8df4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.807372:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d8df4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.807380:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d8df4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.807922:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596918.807931:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d8df4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.807941:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d8df4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.807963:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea700) 00010000:00010000:0.0:1789596918.807967:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596918.807973:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d8df4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.807980:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d8df4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.808031:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8dfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.808037:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8dfb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.808043:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8dfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.808049:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0030a00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596918.808052:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8dfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.808058:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8dfb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.808067:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ea8e0f18500) 00010000:00010000:0.0:1789596918.808069:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596918.808072:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8dfb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.808078:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8dfb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.808150:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8ded lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451f3 expref: 10 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.808163:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea700) 00010000:00010000:0.0:1789596918.808166:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596918.808178:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8ded lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451f3 expref: 10 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596918.808189:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0031600, rc 0) 00000100:00100000:0.0:1789596918.809776:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+9:14412:x1876527944942464:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 5109us (5544us total) trans 0 rc 301/301 00000100:00100000:0.0:1789596918.809790:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 18 00000100:00100000:2.0:1789596918.823878:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596918.824065:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944942592 00000100:00100000:1.0:1789596918.824079:0:14386:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944942592 00000100:00100000:1.0:1789596918.824155:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 0 00000100:00100000:1.0:1789596918.824166:0:14386:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+9:14412:x1876527944942592:12345-192.168.202.44@tcp:700:lfs.0 00000100:00100000:1.0:1789596918.824307:0:14386:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+9:14412:x1876527944942592:12345-192.168.202.44@tcp:700:lfs.0 Request processed in 141us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596918.824316:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 0 00000100:00100000:3.0:1789596918.827946:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596918.830128:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944942848 00000100:00100000:1.0:1789596918.830149:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944942848 00000100:00100000:1.0:1789596918.830260:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 19 00000100:00100000:1.0:1789596918.830273:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+9:14412:x1876527944942848:12345-192.168.202.44@tcp:36:lfs.0 00010000:00010000:1.0:1789596918.830933:0:14377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596918.830967:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8d30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34516e expref: 9 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.830993:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea700) 00010000:00010000:1.0:1789596918.830999:0:14377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789596918.833300:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e02 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.833349:0:14377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8d68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451d0 expref: 5 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.833538:0:14377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e02 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.833593:0:14377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8d68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451d0 expref: 5 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.833614:0:14377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8d68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451d0 expref: 5 pid: 14379 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596918.833653:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14377:1876527964853504:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789596918.833788:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c90563c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789596918.841073:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14377:1876527964853504:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596918.841128:0:14377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e02 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596918.842121:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596918.843174:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944942976 00000100:00100000:2.0:1789596918.843198:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944942976 00010000:00010000:2.0:1789596918.843255:0:14362:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8d68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451d0 expref: 6 pid: 14379 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596918.843523:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 9 00000100:00100000:2.0:1789596918.843536:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa446680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+6:2354:x1876527944942976:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789596918.843558:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789596918.843566:0:14362:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8d68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451d0 expref: 6 pid: 14379 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596918.843582:0:14362:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8d68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451d0 expref: 6 pid: 14379 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596918.843609:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8d68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451d0 expref: 6 pid: 14379 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596918.843631:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea700) 00010000:00010000:2.0:1789596918.843637:0:14362:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e02 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596918.843647:0:14362:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596918.843656:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e02 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596918.843695:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789596918.843774:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa446680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+5:2354:x1876527944942976:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 240us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596918.843783:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 9 00010000:00010000:1.0:1789596918.844794:0:14377:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.844810:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.844878:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e09 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.844892:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.844904:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596918.856042:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789596918.856576:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.856591:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e02 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.856600:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.856632:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596918.856639:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.856648:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e02 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.856670:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8e0eea700) 00010000:00010000:1.0:1789596918.856674:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596918.856681:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e02 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.856688:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e02 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789596918.856717:0:14377:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa7fd593 reply state 00000000b177b582 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596918.856728:0:14377:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789596918.859016:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+10:14412:x1876527944942848:12345-192.168.202.44@tcp:36:lfs.0 Request processed in 28727us (31067us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789596918.859033:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 19 00010000:00010000:1.0:1789596918.866771:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.866797:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e09 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.866807:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.866874:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32a00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596918.866880:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.866890:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e09 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.866910:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ea8c36d5000) 00010000:00010000:1.0:1789596918.866914:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596918.866920:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e09 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.866927:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e09 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596918.957099:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596918.957389:0:16605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944943104 00000100:00100000:1.0:1789596918.957402:0:16605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944943104 00000100:00100000:1.0:1789596918.957480:0:16605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 20 00000100:00100000:1.0:1789596918.957492:0:16605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+9:14420:x1876527944943104:12345-192.168.202.44@tcp:101:lctl.0 00010000:00010000:1.0:1789596918.957523:0:16605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596918.957555:0:16605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c3451fa expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.957642:0:16605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.957660:0:16605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.957687:0:16605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596918.957735:0:16605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789596918.957740:0:16605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789596918.957791:0:16605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.957879:0:16605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451fa expref: 11 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.957903:0:16605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32e00/0x8973ae90b38d8e17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c3451fa expref: 10 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.957912:0:16605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8c36d5000) 00010000:00010000:1.0:1789596918.957915:0:16605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789596918.957919:0:16605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32e00, rc 0) 00000100:00100000:1.0:1789596918.957991:0:16605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+10:14420:x1876527944943104:12345-192.168.202.44@tcp:101:lctl.0 Request processed in 502us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596918.957998:0:16605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 20 00000100:00100000:2.0:1789596918.978559:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596918.978711:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944943232 00000100:00100000:3.0:1789596918.978721:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944943232 00000100:00100000:3.0:1789596918.978777:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 21 00000100:00100000:3.0:1789596918.978786:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+5:14421:x1876527944943232:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:3.0:1789596918.978809:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596918.978887:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d8e1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345201 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.978948:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8e25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.978961:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8e25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.978975:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8e25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596918.979008:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789596918.979011:0:14379:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789596918.979033:0:14379:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8e25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.979184:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d8e1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345201 expref: 7 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.979204:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6a00/0x8973ae90b38d8e25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345201 expref: 6 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596918.979212:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8c36d5000) 00010000:00010000:3.0:1789596918.979216:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789596918.979219:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ff4e6a00, rc 0) 00000100:00100000:3.0:1789596918.979280:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+6:14421:x1876527944943232:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 495us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596918.979288:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 21 00000100:00100000:2.0:1789596918.982322:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596918.982493:0:16605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944943360 00000100:00100000:1.0:1789596918.982511:0:16605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944943360 00000100:00100000:1.0:1789596918.982603:0:16605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 22 00000100:00100000:1.0:1789596918.982616:0:16605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+6:14421:x1876527944943360:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:1.0:1789596918.982645:0:16605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596918.982673:0:16605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345208 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.982794:0:16605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.982813:0:16605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.982868:0:16605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.982888:0:16605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.982896:0:16605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596918.982903:0:16605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003189:0:16605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d8e41 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003215:0:16605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d8e41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003230:0:16605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d8e41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596919.003279:0:16605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789596919.003283:0:16605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789596919.003313:0:16605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d8e41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003348:0:16605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003355:0:16605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e33 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003362:0:16605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003368:0:16605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a33200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596919.003373:0:16605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003381:0:16605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003396:0:16605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8c36d5000) 00010000:00010000:1.0:1789596919.003399:0:16605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596919.003405:0:16605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003412:0:16605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003429:0:16605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003436:0:16605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003442:0:16605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003453:0:16605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596919.003457:0:16605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003463:0:16605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003471:0:16605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ea8c36d5f00) 00010000:00010000:1.0:1789596919.003473:0:16605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596919.003476:0:16605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003482:0:16605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003522:0:16605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345208 expref: 8 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003536:0:16605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d8e41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345208 expref: 7 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.003543:0:16605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ea8c36d5800) 00010000:00010000:1.0:1789596919.003546:0:16605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789596919.003548:0:16605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32600, rc 0) 00000100:00100000:1.0:1789596919.003744:0:16605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+7:14421:x1876527944943360:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 21129us (21429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596919.003754:0:16605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 22 00000100:00100000:2.0:1789596919.009915:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596919.009994:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944943616 00000100:00100000:1.0:1789596919.010041:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944943616 00000100:00100000:1.0:1789596919.010121:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 23 00000100:00100000:1.0:1789596919.010132:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+7:14421:x1876527944943616:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:1.0:1789596919.010152:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596919.010172:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32000/0x8973ae90b38d8e48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c34520f expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596919.010267:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789596919.010729:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32000/0x8973ae90b38d8e48 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34520f expref: 9 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.010744:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8c36d5000) 00010000:00010000:1.0:1789596919.010747:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789596919.010752:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32000/0x8973ae90b38d8e48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34520f expref: 9 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.010767:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32000, rc 0) 00000100:00100000:1.0:1789596919.010928:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+8:14421:x1876527944943616:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 798us (1033us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1789596919.010936:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 23 00000100:00100000:2.0:1789596919.014445:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596919.014554:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944943872 00000100:00100000:0.0:1789596919.014565:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944943872 00000100:00100000:0.0:1789596919.014638:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 24 00000100:00100000:0.0:1789596919.014651:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+8:14421:x1876527944943872:12345-192.168.202.44@tcp:36:lfs.0 00010000:00010000:0.0:1789596919.014707:0:14378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596919.014734:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d8e41 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345208 expref: 8 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.014755:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ea8c36d5800) 00010000:00010000:0.0:1789596919.014766:0:14378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789596919.014794:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8e56 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.014808:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8e56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.014866:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8e56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789596919.015114:0:14378:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad439166 reply state 00000000c0ee4c66 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8e56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596919.015125:0:14378:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789596919.015147:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789596919.015232:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+9:14421:x1876527944943872:12345-192.168.202.44@tcp:36:lfs.0 Request processed in 585us (796us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789596919.015240:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 24 00010000:00010000:0.0:1789596919.017369:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8e56 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.017384:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8e56 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.017392:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8e56 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.017398:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596919.017403:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8e56 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.017411:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8e56 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.017424:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ea8e0f18500) 00010000:00010000:0.0:1789596919.017428:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789596919.017432:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8e56 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.017439:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8e56 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596919.017863:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596919.017999:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944944128 00000100:00100000:1.0:1789596919.018011:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944944128 00000100:00100000:1.0:1789596919.018070:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2 00000100:00100000:1.0:1789596919.018081:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+8:14421:x1876527944944128:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:1.0:1789596919.018632:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+9:14421:x1876527944944128:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 550us (769us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789596919.018641:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2 00000100:00100000:2.0:1789596919.022900:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596919.022987:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944944384 00000100:00100000:3.0:1789596919.023012:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944944384 00000100:00100000:3.0:1789596919.023083:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 25 00000100:00100000:3.0:1789596919.023104:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+9:14421:x1876527944944384:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:3.0:1789596919.023128:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789596919.023149:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d8e5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345216 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.023220:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8e64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.023234:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8e64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.023246:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8e64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.023261:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d8e6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.023269:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d8e6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.023276:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d8e6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789596919.023387:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789596919.023477:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8e64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.023485:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8e64 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.023664:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8e64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.023671:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e6c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596919.023676:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8e64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.023684:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8e64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.023697:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8c36d5000) 00010000:00010000:3.0:1789596919.023700:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596919.023705:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8e64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.023712:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e6c00/0x8973ae90b38d8e64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.023726:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d8e6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.023732:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d8e6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.023738:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d8e6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.023743:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7e00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:3.0:1789596919.023746:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d8e6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.023762:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d8e6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.023771:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ea8d55e5600) 00010000:00010000:3.0:1789596919.023773:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789596919.023776:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d8e6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.023783:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7e00/0x8973ae90b38d8e6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.024070:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d8e5d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345216 expref: 11 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.024083:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8c36d5000) 00010000:00010000:3.0:1789596919.024094:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789596919.024098:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d8e5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345216 expref: 11 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.024109:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ff4e7c00, rc 0) 00000100:00100000:3.0:1789596919.024183:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+10:14421:x1876527944944384:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 1081us (1293us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1789596919.024191:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 25 00000100:00100000:2.0:1789596919.027253:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596919.027354:0:16605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944944512 00000100:00100000:1.0:1789596919.027364:0:16605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944944512 00000100:00100000:1.0:1789596919.027421:0:16605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 26 00000100:00100000:1.0:1789596919.027432:0:16605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+10:14421:x1876527944944512:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:1.0:1789596919.027456:0:16605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596919.027479:0:16605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32000/0x8973ae90b38d8e79 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c34521d expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.027581:0:16605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e80 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.027606:0:16605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.027618:0:16605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596919.027644:0:16605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789596919.027648:0:16605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789596919.027664:0:16605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.027690:0:16605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32000/0x8973ae90b38d8e79 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34521d expref: 12 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.027707:0:16605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34521d expref: 11 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.027716:0:16605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ea8c36d5f00) 00010000:00010000:1.0:1789596919.027719:0:16605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789596919.027739:0:16605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32a00, rc 0) 00000100:00100000:1.0:1789596919.027803:0:16605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+11:14421:x1876527944944512:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 372us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596919.027810:0:16605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 26 00000100:00100000:2.0:1789596919.040949:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596919.041122:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944944640 00000100:00100000:1.0:1789596919.041131:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944944640 00000100:00100000:1.0:1789596919.041185:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 3 00000100:00100000:1.0:1789596919.041194:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+11:14421:x1876527944944640:12345-192.168.202.44@tcp:37:lfs.0 00000100:00100000:1.0:1789596919.056683:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+11:14421:x1876527944944640:12345-192.168.202.44@tcp:37:lfs.0 Request processed in 15478us (15732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596919.056697:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 3 00000100:00100000:2.0:1789596919.060913:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596919.061006:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944944896 00000100:00100000:3.0:1789596919.061017:0:14381:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944944896 00000100:00100000:3.0:1789596919.061187:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 4 00000100:00100000:3.0:1789596919.061198:0:14381:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef53d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+11:14421:x1876527944944896:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:3.0:1789596919.061456:0:14381:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef53d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+12:14421:x1876527944944896:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 259us (552us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789596919.061464:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 4 00000100:00100000:2.0:1789596919.120652:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596919.120752:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944945024 00000100:00100000:1.0:1789596919.120761:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944945024 00000100:00100000:1.0:1789596919.120856:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 27 00000100:00100000:1.0:1789596919.120866:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+10:14427:x1876527944945024:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:1.0:1789596919.120885:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596919.120906:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32000/0x8973ae90b38d8e87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345224 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.120964:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.120978:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.120990:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121004:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121026:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121033:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121145:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d8e9c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121155:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d8e9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121161:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d8e9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596919.121189:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789596919.121192:0:14377:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789596919.121228:0:14377:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d8e9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121241:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121247:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e8e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121254:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121259:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a32800 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596919.121265:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121282:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121294:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8c36d5000) 00010000:00010000:1.0:1789596919.121296:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596919.121301:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121307:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32800/0x8973ae90b38d8e8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121321:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121326:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121332:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121337:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8f6a33200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596919.121340:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121345:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121351:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ea8c36d5300) 00010000:00010000:1.0:1789596919.121354:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596919.121356:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121372:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33200/0x8973ae90b38d8e95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121402:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32000/0x8973ae90b38d8e87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345224 expref: 12 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121418:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32600/0x8973ae90b38d8e9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345224 expref: 11 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.121424:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ea8c36d5f00) 00010000:00010000:1.0:1789596919.121426:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789596919.121428:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8f6a32600, rc 0) 00000100:00100000:1.0:1789596919.121487:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+11:14427:x1876527944945024:12345-192.168.202.44@tcp:101:bash.0 Request processed in 623us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596919.121495:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 27 00000100:00100000:2.0:1789596919.125358:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596919.125433:0:16605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944945280 00000100:00100000:1.0:1789596919.125443:0:16605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944945280 00000100:00100000:1.0:1789596919.125499:0:16605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 28 00000100:00100000:1.0:1789596919.125508:0:16605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+11:14427:x1876527944945280:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:1.0:1789596919.125528:0:16605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596919.125547:0:16605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8ea3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c34522b expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.125665:0:16605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8c00/0x8973ae90b38d8eaa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.125680:0:16605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e80 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34521d expref: 11 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.125700:0:16605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8c00/0x8973ae90b38d8eaa lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.125732:0:16605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34521d expref: 11 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.125745:0:16605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e80 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34521d expref: 11 pid: 16605 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596919.125759:0:16605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16605:1876527964853632:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789596919.125879:0:16605:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c69a1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789596919.130529:0:16605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16605:1876527964853632:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789596919.130560:0:16605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8c00/0x8973ae90b38d8eaa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596919.132923:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596919.133071:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944945408 00000100:00100000:3.0:1789596919.133082:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944945408 00010000:00010000:3.0:1789596919.133131:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e80 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34521d expref: 12 pid: 16605 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596919.133176:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 10 00000100:00100000:3.0:1789596919.133186:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+12:2354:x1876527944945408:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596919.133202:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596919.133208:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e80 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34521d expref: 12 pid: 16605 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.133222:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34521d expref: 12 pid: 16605 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.133242:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a32a00/0x8973ae90b38d8e80 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34521d expref: 12 pid: 16605 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.133257:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ea8c36d5f00) 00010000:00010000:3.0:1789596919.133261:0:14364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8c00/0x8973ae90b38d8eaa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.133271:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8c00/0x8973ae90b38d8eaa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.133278:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8c00/0x8973ae90b38d8eaa lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596919.133327:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789596919.133381:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+11:2354:x1876527944945408:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 196us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596919.133389:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 10 00010000:00010000:2.0:1789596919.133523:0:16605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8c00/0x8973ae90b38d8eaa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.133531:0:16605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8c00/0x8973ae90b38d8eaa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.133554:0:16605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8eb1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.133564:0:16605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.133573:0:16605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.134273:0:16605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8eb8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.134285:0:16605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.134303:0:16605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596919.134315:0:16605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789596919.134346:0:16605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8c00/0x8973ae90b38d8eaa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.134353:0:16605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8c00/0x8973ae90b38d8eaa lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.134360:0:16605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8c00/0x8973ae90b38d8eaa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.134367:0:16605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f8c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596919.134371:0:16605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8c00/0x8973ae90b38d8eaa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.134378:0:16605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8c00/0x8973ae90b38d8eaa lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.134388:0:16605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ea8c36d5f00) 00010000:00010000:2.0:1789596919.134391:0:16605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596919.134394:0:16605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8c00/0x8973ae90b38d8eaa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.134400:0:16605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8c00/0x8973ae90b38d8eaa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789596919.134412:0:16605:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029315dc4 reply state 00000000211f2e3d transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596919.134434:0:16605:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789596919.134477:0:16605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8f6a33a00/0x8973ae90b38d8ea3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34522b expref: 14 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.134492:0:16605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34522b expref: 13 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.134500:0:16605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ea8e0eeab00) 00010000:00010000:2.0:1789596919.134502:0:16605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789596919.134504:0:16605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427c00, rc 0) 00000100:00100000:2.0:1789596919.134556:0:16605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+14:14427:x1876527944945280:12345-192.168.202.44@tcp:101:bash.0 Request processed in 9048us (9206us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789596919.134563:0:16605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 28 00010000:00010000:0.0:1789596919.137227:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596919.139653:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8eb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.139671:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8eb1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.139679:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8eb1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.139685:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596919.139690:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8eb1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.139712:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8eb1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.139729:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ea8e0eea100) 00010000:00010000:1.0:1789596919.139733:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596919.139738:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8eb1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.139744:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8eb1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596919.146860:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596919.147283:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944945536 00000100:00100000:1.0:1789596919.147293:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944945536 00000100:00100000:1.0:1789596919.147347:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 29 00000100:00100000:1.0:1789596919.147357:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+13:14427:x1876527944945536:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:1.0:1789596919.147383:0:14377:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596919.147405:0:14377:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8200/0x8973ae90b38d8ec6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345232 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.147473:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9e00/0x8973ae90b38d8ecd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.147487:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9e00/0x8973ae90b38d8ecd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.147499:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9e00/0x8973ae90b38d8ecd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789596919.147541:0:14377:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789596919.147558:0:14377:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789596919.147580:0:14377:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9e00/0x8973ae90b38d8ecd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.147590:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9e00/0x8973ae90b38d8ecd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.147619:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8200/0x8973ae90b38d8ec6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345232 expref: 15 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.147636:0:14377:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9e00/0x8973ae90b38d8ecd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345232 expref: 14 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.147644:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ea8e0eeab00) 00010000:00010000:1.0:1789596919.147647:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789596919.147651:0:14377:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea9021f9e00, rc 0) 00000100:00100000:1.0:1789596919.147763:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+14:14427:x1876527944945536:12345-192.168.202.44@tcp:101:bash.0 Request processed in 407us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596919.147770:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 29 00000100:00100000:3.0:1789596919.150437:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596919.150552:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944945792 00000100:00100000:0.0:1789596919.150562:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944945792 00000100:00100000:0.0:1789596919.150623:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 5 00000100:00100000:0.0:1789596919.150648:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+14:14427:x1876527944945792:12345-192.168.202.44@tcp:35:bash.0 00000100:00100000:0.0:1789596919.151027:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+15:14427:x1876527944945792:12345-192.168.202.44@tcp:35:bash.0 Request processed in 379us (597us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789596919.151034:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 5 00000100:00100000:3.0:1789596919.225924:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596919.226040:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944946048 00000100:00100000:0.0:1789596919.226055:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944946048 00000100:00100000:0.0:1789596919.226122:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 30 00000100:00100000:0.0:1789596919.226133:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+15:14437:x1876527944946048:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:0.0:1789596919.226158:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596919.226178:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8ed4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345239 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789596919.226270:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789596919.226388:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8ed4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345239 expref: 17 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.226404:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ea8c36d5000) 00010000:00010000:0.0:1789596919.226407:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789596919.226412:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8ed4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345239 expref: 17 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.226430:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0031600, rc 0) 00000100:00100000:0.0:1789596919.226506:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+16:14437:x1876527944946048:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 375us (590us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1789596919.226514:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 30 00000100:00100000:1.0:1789596919.229935:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596919.230121:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944946304 00000100:00100000:0.0:1789596919.230142:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944946304 00000100:00100000:0.0:1789596919.230196:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 6 00000100:00100000:0.0:1789596919.230205:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+16:14437:x1876527944946304:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:0.0:1789596919.230426:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+17:14437:x1876527944946304:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 221us (499us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789596919.230433:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 6 00000100:00100000:3.0:1789596919.258618:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596919.258738:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944946560 00000100:00100000:2.0:1789596919.258749:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944946560 00000100:00100000:2.0:1789596919.258844:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 31 00000100:00100000:2.0:1789596919.258857:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+17:14440:x1876527944946560:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:2.0:1789596919.258880:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596919.258903:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8ee2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345240 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.259003:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8ee9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.259019:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.259063:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596919.259077:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789596919.259230:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8ee2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345240 expref: 20 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.259249:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345240 expref: 19 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.259258:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ea8e0eeab00) 00010000:00010000:2.0:1789596919.259261:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596919.259264:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427400, rc 0) 00000100:00100000:2.0:1789596919.259326:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+19:14440:x1876527944946560:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 473us (718us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789596919.259334:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 31 00000100:00100000:2.0:1789596919.262764:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596919.262857:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944946688 00000100:00100000:0.0:1789596919.262867:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944946688 00000100:00100000:0.0:1789596919.262917:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 32 00000100:00100000:0.0:1789596919.262927:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+19:14440:x1876527944946688:12345-192.168.202.44@tcp:54:lfs.0 00010000:00010000:0.0:1789596919.262988:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8ef7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.263004:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.263015:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.263041:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.263059:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8ef7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.263067:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.263073:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596919.263077:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.263108:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.263121:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ea8e0eeab00) 00010000:00010000:0.0:1789596919.263124:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789596919.263129:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8ef7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.263135:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8ef7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596919.263205:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+19:14440:x1876527944946688:12345-192.168.202.44@tcp:54:lfs.0 Request processed in 279us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596919.263213:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 32 00000100:00100000:3.0:1789596919.265688:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596919.265766:0:16492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944946816 00000100:00100000:0.0:1789596919.265776:0:16492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944946816 00000100:00100000:0.0:1789596919.265855:0:16492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 0 00000100:00100000:0.0:1789596919.265864:0:16492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa447800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+19:2354:x1876527944946816:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596919.265879:0:16492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596919.265900:0:16492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8ee9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345240 expref: 19 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.265917:0:16492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ea8e0eeab00) 00010000:00010000:0.0:1789596919.265921:0:16492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596919.265972:0:16492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa447800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+18:2354:x1876527944946816:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 108us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596919.265979:0:16492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 0 00000100:00100000:3.0:1789596919.267787:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596919.268172:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944947072 00000100:00100000:0.0:1789596919.268182:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944947072 00000100:00100000:0.0:1789596919.268226:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 7 00000100:00100000:0.0:1789596919.268234:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+18:14440:x1876527944947072:12345-192.168.202.44@tcp:35:lfs.0 00000100:00100000:0.0:1789596919.268517:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+19:14440:x1876527944947072:12345-192.168.202.44@tcp:35:lfs.0 Request processed in 282us (736us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789596919.268525:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 7 00000040:00080000:1.0:1789596919.515750:0:14409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789596919.527296:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596919.527446:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944947328 00000100:00100000:2.0:1789596919.527460:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944947328 00000100:00100000:2.0:1789596919.527543:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 33 00000100:00100000:2.0:1789596919.527554:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+19:14471:x1876527944947328:12345-192.168.202.44@tcp:101:cat.0 00010000:00010000:2.0:1789596919.527580:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596919.527725:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8efe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345247 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.527850:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f05 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.527879:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.527891:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596919.527903:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789596919.528031:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8efe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345247 expref: 22 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.528061:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345247 expref: 21 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.528070:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ea8e0eeab00) 00010000:00010000:2.0:1789596919.528073:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596919.528077:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427000, rc 0) 00000100:00100000:2.0:1789596919.528167:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+21:14471:x1876527944947328:12345-192.168.202.44@tcp:101:cat.0 Request processed in 615us (1180us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789596919.528174:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 33 00000100:00100000:1.0:1789596919.532007:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596919.532116:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944947584 00000100:00100000:0.0:1789596919.532127:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944947584 00000100:00100000:0.0:1789596919.532182:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 8 00000100:00100000:0.0:1789596919.532191:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+21:14471:x1876527944947584:12345-192.168.202.44@tcp:35:cat.0 00000100:00100000:0.0:1789596919.532525:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+22:14471:x1876527944947584:12345-192.168.202.44@tcp:35:cat.0 Request processed in 333us (526us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1789596919.532532:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 8 00000100:00100000:3.0:1789596919.536700:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596919.537458:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944947712 00000100:00100000:0.0:1789596919.537469:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944947712 00000100:00100000:0.0:1789596919.537539:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1 00000100:00100000:0.0:1789596919.537548:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+22:2353:x1876527944947712:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596919.537565:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596919.537603:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f05 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345247 expref: 22 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.537623:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ea8e0eeab00) 00010000:00010000:0.0:1789596919.537629:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596919.537760:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+21:2353:x1876527944947712:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 211us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596919.537784:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1 00000100:00100000:2.0:1789596919.600104:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596919.600262:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944947968 00000100:00100000:0.0:1789596919.600272:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944947968 00000100:00100000:0.0:1789596919.600328:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 34 00000100:00100000:0.0:1789596919.600338:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+21:14477:x1876527944947968:12345-192.168.202.44@tcp:101:dd.0 00010000:00010000:0.0:1789596919.600362:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596919.600382:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8f13 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c34524e expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.600474:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8f1a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.600488:0:14378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8eb8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34522b expref: 22 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.600497:0:14378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9e00/0x8973ae90b38d8ecd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345232 expref: 22 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.600506:0:14378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8f1a lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.600537:0:14378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9e00/0x8973ae90b38d8ecd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345232 expref: 22 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.600550:0:14378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9e00/0x8973ae90b38d8ecd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345232 expref: 22 pid: 14377 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596919.600564:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef649c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14378:1876527964853760:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596919.600676:0:14378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34522b expref: 22 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.600686:0:14378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8eb8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34522b expref: 22 pid: 16605 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596919.600695:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef649180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14378:1876527964853888:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789596919.600718:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6f08180 going to sleep for 11 seconds 00000100:00100000:0.0:1789596919.606211:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef649c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14378:1876527964853760:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789596919.606224:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef649180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14378:1876527964853888:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596919.606251:0:14378:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8f1a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596919.607340:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596919.607417:0:16492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944948096 00000100:00100000:0.0:1789596919.607426:0:16492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944948096 00010000:00010000:0.0:1789596919.607458:0:16492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9e00/0x8973ae90b38d8ecd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345232 expref: 23 pid: 14377 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596919.607497:0:16492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 11 00000100:00100000:0.0:1789596919.607505:0:16492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900452050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+23:2353:x1876527944948096:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596919.607519:0:16492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596919.607525:0:16492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9e00/0x8973ae90b38d8ecd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345232 expref: 23 pid: 14377 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.607536:0:16492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9e00/0x8973ae90b38d8ecd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345232 expref: 23 pid: 14377 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.607572:0:16492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9e00/0x8973ae90b38d8ecd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345232 expref: 23 pid: 14377 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.607587:0:16492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ea8e0eeab00) 00010000:00010000:0.0:1789596919.607604:0:16492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8f1a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.607613:0:16492:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8f1a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.607619:0:16492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596919.607674:0:16492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900452050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+22:2353:x1876527944948096:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 169us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596919.607680:0:16492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 11 00000100:00100000:3.0:1789596919.611617:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596919.611788:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944948224 00000100:00100000:0.0:1789596919.611799:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944948224 00010000:00010000:0.0:1789596919.611874:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8eb8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34522b expref: 22 pid: 16605 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596919.611918:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 12 00000100:00100000:0.0:1789596919.611927:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+22:2354:x1876527944948224:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596919.611944:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596919.611951:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8eb8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34522b expref: 22 pid: 16605 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.611965:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34522b expref: 22 pid: 16605 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.611997:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8eb8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34522b expref: 22 pid: 16605 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.612013:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ea8e0eeab00) 00010000:00010000:0.0:1789596919.612019:0:14364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8f1a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.612028:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8f1a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.612036:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8f1a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.612089:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596919.612148:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+21:2354:x1876527944948224:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 222us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596919.612157:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 12 00010000:00010000:2.0:1789596919.612627:0:14378:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8f1a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.612636:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8f1a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596919.612655:0:14378:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789596919.612846:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0031600/0x8973ae90b38d8f13 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34524e expref: 22 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.612864:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030a00/0x8973ae90b38d8f1a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34524e expref: 21 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.612872:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ea8e0eeab00) 00010000:00010000:2.0:1789596919.612875:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789596919.612877:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030a00, rc 0) 00000100:00100000:2.0:1789596919.612902:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+21:14477:x1876527944947968:12345-192.168.202.44@tcp:101:dd.0 Request processed in 12566us (12810us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789596919.612909:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 34 00000100:00100000:3.0:1789596919.616766:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596919.617031:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944948480 00000100:00100000:1.0:1789596919.617042:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944948480 00000100:00100000:1.0:1789596919.617128:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 35 00000100:00100000:1.0:1789596919.617139:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+21:14477:x1876527944948480:12345-192.168.202.44@tcp:36:dd.0 00010000:00010000:1.0:1789596919.617416:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d8f28 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.617433:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d8f28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596919.617459:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d8f28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789596919.617516:0:14377:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1789596919.617552:0:14377:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e3775729 reply state 0000000060c638a2 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d8f28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596919.617561:0:14377:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789596919.617653:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+24:14477:x1876527944948480:12345-192.168.202.44@tcp:36:dd.0 Request processed in 516us (896us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1789596919.617758:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 35 00000020:00080000:1.0:1789596919.617763:0:14377:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789596919.619777:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d8f28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.619792:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d8f28 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.619800:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d8f28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.619806:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f9200 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596919.619811:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d8f28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.619882:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d8f28 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.619899:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ea8e0eeab00) 00010000:00010000:0.0:1789596919.619902:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596919.619907:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d8f28 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.619914:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9200/0x8973ae90b38d8f28 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596919.621322:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596919.622278:0:16605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944948608 00000100:00100000:2.0:1789596919.622292:0:16605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944948608 00000100:00100000:2.0:1789596919.622396:0:16605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 36 00000100:00100000:2.0:1789596919.622408:0:16605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+23:14477:x1876527944948608:12345-192.168.202.44@tcp:101:dd.0 00010000:00010000:2.0:1789596919.622433:0:16605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596919.622453:0:16605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8f2f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345255 expref: -99 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.622514:0:16605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8f2f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345255 expref: 24 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.622531:0:16605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8f2f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345255 expref: 24 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.622551:0:16605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ea8e0eeab00) 00010000:00010000:2.0:1789596919.622570:0:16605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596919.622574:0:16605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426e00, rc 0) 00000100:00100000:2.0:1789596919.622639:0:16605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+24:14477:x1876527944948608:12345-192.168.202.44@tcp:101:dd.0 Request processed in 234us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596919.622645:0:16605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 36 00000100:00100000:3.0:1789596919.633428:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596919.633546:0:16492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944948864 00000100:00100000:0.0:1789596919.633556:0:16492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944948864 00000100:00100000:0.0:1789596919.633627:0:16492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2 00000100:00100000:0.0:1789596919.633638:0:16492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+24:14477:x1876527944948864:12345-192.168.202.44@tcp:103:dd.0 00010000:00010000:0.0:1789596919.633654:0:16492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596919.633692:0:16492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8f2f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345255 expref: 24 pid: 16605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.633711:0:16492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ea8e0eeab00) 00010000:00010000:0.0:1789596919.633716:0:16492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596919.633773:0:16492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+23:14477:x1876527944948864:12345-192.168.202.44@tcp:103:dd.0 Request processed in 137us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596919.633779:0:16492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2 00000100:00100000:3.0:1789596919.636221:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596919.636336:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944948992 00000100:00100000:2.0:1789596919.636346:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944948992 00000100:00100000:2.0:1789596919.636404:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 37 00000100:00100000:2.0:1789596919.636414:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+23:14477:x1876527944948992:12345-192.168.202.44@tcp:58:dd.0 00010000:00010000:2.0:1789596919.636506:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8f36 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.636526:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8f36 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596919.636539:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8f36 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789596919.637298:0:14379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789596919.637456:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789596919.637525:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789596919.637636:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+23:14477:x1876527944948992:12345-192.168.202.44@tcp:58:dd.0 Request processed in 1221us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596919.637646:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 37 00000100:00100000:3.0:1789596919.640852:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596919.640941:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944949120 00000100:00100000:0.0:1789596919.640952:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944949120 00000100:00100000:0.0:1789596919.641014:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 38 00000100:00100000:0.0:1789596919.641025:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+23:14477:x1876527944949120:12345-192.168.202.44@tcp:101:dd.0 00010000:00010000:0.0:1789596919.641062:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789596919.641093:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d8f3d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c34525c expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.641152:0:14378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8f36 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.641163:0:14378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d8f3d lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34525c expref: 24 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.641181:0:14378:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8f36 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.641194:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d8f3d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34525c expref: 24 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.641207:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ea8e0eeab00) 00010000:00010000:0.0:1789596919.641210:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789596919.641214:0:14378:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d8f3d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34525c expref: 24 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596919.641221:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8c0030800, rc 0) 00000100:00100000:0.0:1789596919.641281:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+24:14477:x1876527944949120:12345-192.168.202.44@tcp:101:dd.0 Request processed in 258us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596919.641289:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 38 00000001:00080000:2.0:1789596919.965143:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934607 is committed 00000001:00080000:2.0:1789596919.965175:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:2.0:1789596919.965451:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:2.0:1789596919.965463:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:2.0:1789596919.965673:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1789596920.155558:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789596920.347188:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964854272:0@lo:400:kworker.0 00000100:00100000:0.0:1789596920.347258:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596920.347328:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8ef649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964854016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596920.347357:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789596920.347372:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964854400:0@lo:400:kworker.0 00000100:00100000:2.0:1789596920.347429:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596920.347429:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596920.347497:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964854528:0@lo:400:kworker.0 00000100:00100000:0.0:1789596920.347518:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964854272 00000100:00100000:0.0:1789596920.347527:0:15061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964854272 00000100:00100000:2.0:1789596920.347540:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596920.347589:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789596920.347599:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3306:1876527964854144:0@lo:400:kworker.0 00000100:00100000:0.0:1789596920.347603:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964854400 00000100:00100000:0.0:1789596920.347607:0:15061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964854400 00000100:00100000:0.0:1789596920.347646:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789596920.347659:0:15061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964854272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596920.347665:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596920.347703:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964854656:0@lo:400:kworker.0 00000100:00100000:0.0:1789596920.347722:0:15061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964854272:12345-0@lo:400:kworker.0 Request processed in 63us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596920.347731:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789596920.347747:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596920.347759:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789596920.347771:0:15061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964854400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596920.347804:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964854528 00000100:00100000:2.0:1789596920.347813:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964854528 00000100:00100000:0.0:1789596920.347862:0:15061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876527964854400:12345-0@lo:400:kworker.0 Request processed in 94us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596920.347873:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789596920.347895:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964854656 00000100:00100000:2.0:1789596920.347902:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964854656 00000100:00080000:0.0:1789596920.347904:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789596920.347909:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789596920.347915:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596920.347943:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789596920.347952:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964854528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789596920.348015:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876527964854528:12345-0@lo:400:kworker.0 Request processed in 62us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596920.348017:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964854016 00000100:00100000:2.0:1789596920.348028:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789596920.348029:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964854016 00000100:00100000:2.0:1789596920.348060:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789596920.348070:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964854656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596920.348090:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789596920.348102:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea90000a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964854016:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789596920.348121:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876527964854656:12345-0@lo:400:kworker.0 Request processed in 51us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596920.348130:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00002000:00000024:3.0:1789596920.348137:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789596920.348179:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea90000a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876527964854016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596920.348186:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789596920.348209:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964854144 00000100:00100000:3.0:1789596920.348221:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964854144 00000100:00100000:3.0:1789596920.348247:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789596920.348253:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:3306:x1876527964854144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789596920.348281:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900450450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:725ddb85-e0d3-4aba-b101-0ba8e10978f0+19:3306:x1876527964854144:12345-0@lo:400:kworker.0 Request processed in 29us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596920.348287:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789596920.349168:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789596920.349185:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964854784:0@lo:400:kworker.0 00000100:00100000:0.0:1789596920.349225:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789596920.349280:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964854400:0@lo:400:kworker.0 00000100:00100000:0.0:1789596920.349293:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876527964854272:0@lo:400:kworker.0 00000100:00100000:0.0:1789596920.350161:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964854784 00000100:00100000:0.0:1789596920.350168:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964854784 00000100:00100000:0.0:1789596920.350220:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789596920.350227:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964854784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789596920.350275:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876527964854784:12345-0@lo:400:kworker.0 Request processed in 48us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596920.350281:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789596920.350307:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876527964854784:0@lo:400:kworker.0 00000100:00080000:0.0:1789596920.350440:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789596920.350483:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:725ddb85-e0d3-4aba-b101-0ba8e10978f0:3306:1876527964854144:0@lo:400:kworker.0 00000100:00100000:0.0:1789596920.350495:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876527964854656:0@lo:400:kworker.0 00000100:00100000:0.0:1789596920.350512:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8ef649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876527964854016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789596920.350524:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876527964854528:0@lo:400:kworker.0 00000040:00080000:1.0:1789596920.539494:0:14409:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789596920.539504:0:14409:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789596920.539573:0:14409:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789596920.539580:0:14409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789596920.539706:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37a8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14409:1876527964854912:192.168.202.44@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789596920.539850:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c69a10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789596920.560911:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596920.561162:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944949248 00000100:00100000:2.0:1789596920.561173:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944949248 00000100:00100000:2.0:1789596920.561250:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 0 00000100:00100000:2.0:1789596920.561262:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+12:14478:x1876527944949248:12345-192.168.202.44@tcp:900:lhsmtool_posix.0 00000100:00080000:0.0:1789596920.561293:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789596920.561371:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+12:14478:x1876527944949248:12345-192.168.202.44@tcp:900:lhsmtool_posix.0 Request processed in 110us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596920.561379:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 0 00000100:00100000:1.0:1789596920.561598:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37a8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14409:1876527964854912:192.168.202.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789596920.572690:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596920.574369:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944949376 00000100:00100000:0.0:1789596920.574390:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944949376 00000100:00100000:0.0:1789596920.574491:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 39 00000100:00100000:0.0:1789596920.574503:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+11:14478:x1876527944949376:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789596920.574582:0:14378:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789596920.574865:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+11:14478:x1876527944949376:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 Request processed in 363us (2187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596920.574875:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 39 00000100:00100000:0.0:1789596920.602704:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596920.605259:0:16605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944949504 00000100:00100000:3.0:1789596920.605282:0:16605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944949504 00000100:00100000:3.0:1789596920.605375:0:16605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 40 00000100:00100000:3.0:1789596920.605387:0:16605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+11:14478:x1876527944949504:12345-192.168.202.44@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789596920.605487:0:16605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d8f44 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596920.605508:0:16605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d8f44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596920.605522:0:16605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d8f44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606124:0:16605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f4b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606145:0:16605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606157:0:16605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606188:0:16605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8f52 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606196:0:16605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8f52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606203:0:16605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8f52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596920.606244:0:16605:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789596920.606248:0:16605:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789596920.606264:0:16605:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8f52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606276:0:16605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d8f44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606283:0:16605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d8f44 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606317:0:16605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d8f44 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606324:0:16605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596920.606329:0:16605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d8f44 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606433:0:16605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d8f44 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606446:0:16605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:2.0:1789596920.606449:0:16605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596920.606454:0:16605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d8f44 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606461:0:16605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ff4e7c00/0x8973ae90b38d8f44 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606474:0:16605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606482:0:16605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f4b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606489:0:16605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606494:0:16605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596920.606496:0:16605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606512:0:16605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f4b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606519:0:16605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9ea8e0eead00) 00010000:00010000:2.0:1789596920.606521:0:16605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596920.606524:0:16605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f4b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606530:0:16605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f4b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606544:0:16605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8f52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606550:0:16605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8f52 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606556:0:16605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8f52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606561:0:16605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427400 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596920.606564:0:16605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8f52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606569:0:16605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8f52 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606575:0:16605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ea8e0eeab00) 00010000:00010000:2.0:1789596920.606577:0:16605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596920.606580:0:16605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8f52 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.606593:0:16605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8f52 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16605 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596920.606725:0:16605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+11:14478:x1876527944949504:12345-192.168.202.44@tcp:34:lhsmtool_posix.0 Request processed in 1337us (4035us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596920.606735:0:16605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 40 00000100:00100000:3.0:1789596920.622386:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596920.622572:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944949760 00000100:00100000:2.0:1789596920.622582:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944949760 00000100:00100000:2.0:1789596920.622643:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 41 00000100:00100000:2.0:1789596920.622654:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+11:14478:x1876527944949760:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596920.622675:0:14379:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596920.622696:0:14379:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8f59 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345263 expref: -99 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.622791:0:14379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f60 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.622859:0:14379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.622872:0:14379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596920.622885:0:14379:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789596920.623060:0:14379:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.623082:0:14379:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f60 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.623090:0:14379:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.623097:0:14379:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596920.623113:0:14379:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.623122:0:14379:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f60 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.623135:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ea8e0eeab00) 00010000:00010000:1.0:1789596920.623138:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789596920.623142:0:14379:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f60 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.623149:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f60 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.623206:0:14379:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8f59 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345263 expref: 13 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.623218:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ea8c36d5400) 00010000:00010000:1.0:1789596920.623221:0:14379:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789596920.623225:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8f59 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345263 expref: 13 pid: 14379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.623235:0:14379:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427400, rc 0) 00000100:00100000:1.0:1789596920.623292:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+12:14478:x1876527944949760:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 641us (915us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1789596920.623300:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 41 00000100:00100000:3.0:1789596920.635579:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596920.635768:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944949888 00000100:00100000:1.0:1789596920.635778:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944949888 00000100:00100000:1.0:1789596920.635869:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 42 00000100:00100000:1.0:1789596920.635880:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+12:14478:x1876527944949888:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789596920.635933:0:14377:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789596920.636050:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+12:14478:x1876527944949888:12345-192.168.202.44@tcp:53:lhsmtool_posix.0 Request processed in 172us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596920.636058:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 42 00000100:00100000:0.0:1789596920.653458:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596920.653706:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944950144 00000100:00100000:2.0:1789596920.653718:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944950144 00000100:00100000:2.0:1789596920.653786:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 43 00000100:00100000:2.0:1789596920.653807:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+12:14478:x1876527944950144:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596920.653881:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596920.653902:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8f6e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c34526a expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789596920.654885:0:14378:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:2.0:1789596920.654896:0:14378:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1789596920.654947:0:14378:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1789596920.655681:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f75 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.655700:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.655713:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.655770:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8f6e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34526a expref: 15 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.655892:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34526a expref: 14 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.655902:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ea8e0eead00) 00010000:00010000:2.0:1789596920.655905:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789596920.655909:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427000, rc 0) 00000100:00100000:2.0:1789596920.655969:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+14:14478:x1876527944950144:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 2175us (2521us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1789596920.655978:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 43 00000100:00100000:0.0:1789596920.665177:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596920.665357:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944950400 00000100:00100000:1.0:1789596920.665375:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944950400 00000100:00100000:1.0:1789596920.665432:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 44 00000100:00100000:1.0:1789596920.665441:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+14:14478:x1876527944950400:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789596920.665494:0:14377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596920.665523:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8f75 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34526a expref: 14 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.665542:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ea8e0eead00) 00010000:00010000:1.0:1789596920.665553:0:14377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789596920.665576:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8f83 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.665589:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8f83 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.665598:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8f83 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.665611:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f8a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3336d4ac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.665618:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3336d4ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.665641:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3336d4ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.665913:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8f83 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.665922:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8f83 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.665929:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8f83 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.665935:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f9000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596920.665939:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8f83 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.665947:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8f83 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.665956:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ea8c36d5f00) 00010000:00010000:1.0:1789596920.665959:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596920.665962:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8f83 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.665969:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8f83 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.665979:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3336d4ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.665985:0:14377:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f8a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3336d4ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.665996:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f8a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3336d4ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.666001:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f8600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596920.666004:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f8a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3336d4ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.666011:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f8a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3336d4ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.666019:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x3336d4ac (ffff9ea8c36d5600) 00010000:00010000:1.0:1789596920.666022:0:14377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789596920.666025:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f8a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3336d4ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.666031:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f8a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3336d4ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596920.666117:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+13:14478:x1876527944950400:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 Request processed in 676us (949us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789596920.666125:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 44 00000100:00100000:3.0:1789596920.668863:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596920.668971:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944950528 00000100:00100000:2.0:1789596920.669006:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944950528 00000100:00100000:2.0:1789596920.669060:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 45 00000100:00100000:2.0:1789596920.669079:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+13:14478:x1876527944950528:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596920.669103:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596920.669125:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8f91 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345271 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.669159:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8f98 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.669171:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8f98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.669182:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8f98 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.669277:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8f91 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345271 expref: 15 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.669295:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef426e00/0x8973ae90b38d8f98 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345271 expref: 14 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.669315:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:2.0:1789596920.669317:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789596920.669321:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef426e00, rc 0) 00000100:00100000:2.0:1789596920.669377:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+14:14478:x1876527944950528:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 308us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596920.669384:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 45 00000100:00100000:0.0:1789596920.682705:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596920.682858:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944950784 00000100:00100000:1.0:1789596920.682868:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944950784 00000100:00100000:1.0:1789596920.682935:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 46 00000100:00100000:1.0:1789596920.682945:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+14:14478:x1876527944950784:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789596920.683043:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f9f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.683062:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.683092:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789596920.684085:0:14377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1789596920.684100:0:14377:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 505648283011ns, next at 506648280274ns, rc = 0 00000004:00010000:1.0:1789596920.684192:0:14377:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c71c77a reply state 00000000925b55e8 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596920.684202:0:14377:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789596920.685269:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+16:14478:x1876527944950784:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 Request processed in 2318us (2568us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789596920.685280:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 46 00010000:00010000:1.0:1789596920.689419:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.689438:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f9f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.689446:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f9f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.689452:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f8600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:1.0:1789596920.689458:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f9f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.689466:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f9f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.689492:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:1.0:1789596920.689496:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789596920.689518:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f9f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.689525:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f8600/0x8973ae90b38d8f9f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596920.692549:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596920.693055:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944950912 00000100:00100000:2.0:1789596920.693098:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944950912 00000100:00100000:2.0:1789596920.693169:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 47 00000100:00100000:2.0:1789596920.693180:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+15:14478:x1876527944950912:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596920.693205:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596920.693227:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8fa6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345278 expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.693287:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8fa6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345278 expref: 16 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.693314:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8fa6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345278 expref: 16 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.693335:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:2.0:1789596920.693338:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789596920.693341:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8ef427400, rc 0) 00000100:00100000:2.0:1789596920.693406:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef64b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+16:14478:x1876527944950912:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 228us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596920.693413:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 47 00000100:00100000:0.0:1789596920.696799:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596920.697182:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944951040 00000100:00100000:2.0:1789596920.697199:0:15061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944951040 00000100:00100000:2.0:1789596920.697293:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 12 00000100:00100000:2.0:1789596920.697320:0:15061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:2354:x1876527944951040:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789596920.697646:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789596920.698650:0:15061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:2354:x1876527944951040:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 Request processed in 1327us (1858us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789596920.698662:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 12 00000100:00100000:3.0:1789596920.716698:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596920.717171:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944951296 00000100:00100000:0.0:1789596920.717195:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944951296 00000100:00100000:0.0:1789596920.717272:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 9 00000100:00100000:0.0:1789596920.717284:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+16:14478:x1876527944951296:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789596920.717621:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+17:14478:x1876527944951296:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 Request processed in 337us (935us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1789596920.717629:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 9 00000100:00100000:0.0:1789596920.721352:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596920.722780:0:16605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944951552 00000100:00100000:2.0:1789596920.722845:0:16605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944951552 00000100:00100000:2.0:1789596920.722943:0:16605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 48 00000100:00100000:2.0:1789596920.722955:0:16605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c5783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+17:14478:x1876527944951552:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789596920.723274:0:16605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c5783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+17:14478:x1876527944951552:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 Request processed in 320us (1939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596920.723283:0:16605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 48 00000100:00100000:2.0:1789596920.732787:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596920.734156:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944951680 00000100:00100000:0.0:1789596920.734241:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944951680 00000100:00100000:2.0:1789596920.734499:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 49 00000100:00100000:2.0:1789596920.734513:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+17:14478:x1876527944951680:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789596920.734544:0:14378:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789596920.734574:0:14378:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8fad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c34527f expref: -99 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.734698:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af000/0x8973ae90b38d8fb4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.734717:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af000/0x8973ae90b38d8fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.734731:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af000/0x8973ae90b38d8fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789596920.734808:0:14378:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789596920.734957:0:14378:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af000/0x8973ae90b38d8fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.734993:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427000/0x8973ae90b38d8fad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34527f expref: 19 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.735042:0:14378:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af000/0x8973ae90b38d8fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34527f expref: 18 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.735052:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:2.0:1789596920.735056:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789596920.735061:0:14378:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea8fe9af000, rc 0) 00000100:00100000:2.0:1789596920.735206:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+18:14478:x1876527944951680:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 695us (2440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596920.735214:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 49 00000100:00100000:3.0:1789596920.738691:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596920.738791:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944951808 00000100:00100000:1.0:1789596920.738804:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944951808 00000100:00100000:1.0:1789596920.738906:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 13 00000100:00100000:1.0:1789596920.738925:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:2354:x1876527944951808:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789596920.738951:0:16253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789596920.738982:0:16253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ef869c1/0x8973ae90b38d8fbb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2dd2b3a02c345286 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789596920.739305:0:16253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab14f8, blocks: 0x1 00010000:00010000:1.0:1789596920.739335:0:16253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=505s v=(0 0) 00010000:00010000:1.0:1789596920.739341:0:16253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596920.739353:0:16253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ef869c1/0x8973ae90b38d8fbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345286 expref: 7 pid: 16253 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.739381:0:16253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000ef869c1/0x8973ae90b38d8fbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345286 expref: 7 pid: 16253 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.739397:0:16253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ea9021f8600, rc 0) 00000100:00100000:1.0:1789596920.739474:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+7:2354:x1876527944951808:12345-192.168.202.44@tcp:101:lhsmtool_posix.0 Request processed in 558us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596920.739481:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 13 00000100:00100000:0.0:1789596920.745661:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596920.745783:0:16605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944952064 00000100:00100000:2.0:1789596920.745797:0:16605:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944952064 00000100:00100000:2.0:1789596920.745901:0:16605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 50 00000100:00100000:2.0:1789596920.745912:0:16605:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+18:14478:x1876527944952064:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789596920.746427:0:16605:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+18:14478:x1876527944952064:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 Request processed in 514us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596920.746436:0:16605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 50 00000100:00100000:2.0:1789596920.769355:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596920.769486:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944952192 00000100:00100000:1.0:1789596920.769518:0:14379:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944952192 00000100:00100000:1.0:1789596920.769593:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 51 00000100:00100000:1.0:1789596920.769604:0:14379:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+18:14478:x1876527944952192:12345-192.168.202.44@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789596920.835221:0:5863:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1789596920.835255:0:5863:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1789596920.835962:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8c37a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964855040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789596920.836204:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789596920.836533:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964855040 00000100:00100000:1.0:1789596920.836543:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964855040 00000100:00100000:1.0:1789596920.836613:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789596920.836625:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876527964855040:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789596920.837007:0:15063:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789596920.837011:0:15063:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789596920.837014:0:15063:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789596920.837016:0:15063:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789596920 -> 1789596920 00002000:00010000:1.0:1789596920.837154:0:15063:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789596920.837286:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876527964855040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 662us (1082us total) trans 8589934595 rc 0/0 00000004:00080000:0.0:1789596920.837484:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ea8c37a8a80/2, rc 0, transno 8589934595 00000100:00100000:0.0:1789596920.837494:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8c37a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876527964855040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789596920.837542:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789596920.838166:0:14379:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+14:14478:x1876527944952192:12345-192.168.202.44@tcp:44:lhsmtool_posix.0 Request processed in 68142us (68405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596920.838262:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 51 00000100:00100000:0.0:1789596920.843284:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596920.844454:0:16253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944952320 00000100:00100000:1.0:1789596920.844470:0:16253:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944952320 00000100:00100000:1.0:1789596920.844593:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 15 00000100:00100000:1.0:1789596920.844607:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa65bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+7:2353:x1876527944952320:12345-192.168.202.44@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789596920.844790:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa65bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+7:2353:x1876527944952320:12345-192.168.202.44@tcp:16:lhsmtool_posix.0 Request processed in 185us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596920.844798:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 15 00000100:00100000:0.0:1789596920.858600:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789596920.858718:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944952576 00000100:00100000:1.0:1789596920.858733:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944952576 00000100:00100000:1.0:1789596920.858857:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 52 00000100:00100000:1.0:1789596920.858870:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+14:14478:x1876527944952576:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789596920.858966:0:14377:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789596920.859006:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af000/0x8973ae90b38d8fb4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34527f expref: 14 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.859053:0:14377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:1.0:1789596920.859059:0:14377:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789596920.859113:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8fc2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.859132:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.859145:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789596920.859792:0:14377:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2427a2a reply state 00000000877b5856 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596920.859805:0:14377:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789596920.859981:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+15:14478:x1876527944952576:12345-192.168.202.44@tcp:36:lhsmtool_posix.0 Request processed in 1110us (1395us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1789596920.859989:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 52 00010000:00010000:0.0:1789596920.873454:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8fc2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.873484:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8fc2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.873512:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8fc2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.873519:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f9000 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596920.873524:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8fc2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.873532:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8fc2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.873549:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:0.0:1789596920.873552:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789596920.873556:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8fc2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.873563:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea9021f9000/0x8973ae90b38d8fc2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14377 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596920.875718:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596920.875849:0:15061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944952704 00000100:00100000:2.0:1789596920.875859:0:15061:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944952704 00000100:00100000:2.0:1789596920.875912:0:15061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 16 00000100:00100000:2.0:1789596920.875922:0:15061:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+7:2352:x1876527944952704:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789596920.876146:0:15061:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789596920.876149:0:15061:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789596919 00002000:00010000:2.0:1789596920.876152:0:15061:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789596919 00002000:00010000:2.0:1789596920.876154:0:15061:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789596920 -> 1789596919 00002000:00010000:2.0:1789596920.876156:0:15061:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789596920.876215:0:15061:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+8:2352:x1876527944952704:12345-192.168.202.44@tcp:2:lhsmtool_posix.0 Request processed in 294us (506us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789596920.876223:0:15061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 16 00000100:00100000:2.0:1789596920.886231:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596920.891633:0:15062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944952832 00000100:00100000:0.0:1789596920.891646:0:15062:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944952832 00000100:00100000:1.0:1789596920.891788:0:16253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 17 00000100:00100000:1.0:1789596920.891851:0:16253:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+8:2351:x1876527944952832:12345-192.168.202.44@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789596920.891917:0:16253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc077582/0x8973ae90b38d8fc9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.891940:0:16253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596920.891963:0:16253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596920.891971:0:16253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc077582/0x8973ae90b38d8fc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.891990:0:16253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc077582/0x8973ae90b38d8fc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.892274:0:16253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bc077582/0x8973ae90b38d8fc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.892286:0:16253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc077582/0x8973ae90b38d8fc9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.892296:0:16253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc077582/0x8973ae90b38d8fc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.892305:0:16253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f9800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:1.0:1789596920.892311:0:16253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc077582/0x8973ae90b38d8fc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.892320:0:16253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc077582/0x8973ae90b38d8fc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.892441:0:16253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc077582/0x8973ae90b38d8fc9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596920.892451:0:16253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc077582/0x8973ae90b38d8fc9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789596920.892580:0:16253:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+8:2351:x1876527944952832:12345-192.168.202.44@tcp:1:lhsmtool_posix.0 Request processed in 777us (6356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596920.892589:0:16253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 17 00000100:00100000:0.0:1789596920.897130:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596920.901455:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944953088 00000100:00100000:2.0:1789596920.901473:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944953088 00000100:00100000:2.0:1789596920.901661:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 53 00000100:00100000:2.0:1789596920.901672:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+14:14478:x1876527944953088:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789596920.901751:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af600/0x8973ae90b38d8fd0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.901769:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af600/0x8973ae90b38d8fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.901781:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af600/0x8973ae90b38d8fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.902038:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afc00/0x8973ae90b38d8fd7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.902050:0:14378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8fa6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345278 expref: 15 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.902080:0:14378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afc00/0x8973ae90b38d8fd7 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.902117:0:14378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8fa6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345278 expref: 15 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.902130:0:14378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8fa6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345278 expref: 15 pid: 14378 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596920.902144:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa253100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14378:1876527964855168:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789596920.902475:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c313da80 going to sleep for 11 seconds 00000100:00100000:2.0:1789596920.916423:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa253100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14378:1876527964855168:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789596920.916459:0:14378:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afc00/0x8973ae90b38d8fd7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596920.922367:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596920.922495:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944953216 00000100:00100000:3.0:1789596920.922505:0:14364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944953216 00010000:00010000:3.0:1789596920.922546:0:14364:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8fa6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345278 expref: 16 pid: 14378 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596920.922605:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 13 00000100:00100000:3.0:1789596920.922615:0:14364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c6ec3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+16:2354:x1876527944953216:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789596920.922631:0:14364:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789596920.922638:0:14364:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8fa6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345278 expref: 16 pid: 14378 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596920.922651:0:14364:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8fa6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345278 expref: 16 pid: 14378 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596920.922674:0:14364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427400/0x8973ae90b38d8fa6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345278 expref: 16 pid: 14378 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596920.922690:0:14364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:3.0:1789596920.922696:0:14364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afc00/0x8973ae90b38d8fd7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596920.922706:0:14364:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afc00/0x8973ae90b38d8fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596920.922713:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afc00/0x8973ae90b38d8fd7 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596920.922748:0:14364:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789596920.923022:0:14378:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afc00/0x8973ae90b38d8fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.923031:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afc00/0x8973ae90b38d8fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789596920.923234:0:14378:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789596920.923388:0:14378:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789596920.923435:0:14378:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789596920.923521:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa253100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14378:1876527964855296:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789596920.923596:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596920.923634:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c313d300 going to sleep for 11 seconds 00000100:00100000:3.0:1789596920.924121:0:14364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c6ec3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+18:2354:x1876527944953216:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 1504us (1760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596920.924131:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 13 00000100:00100000:1.0:1789596920.924265:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964855296 00000100:00100000:1.0:1789596920.924272:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964855296 00000100:00100000:1.0:1789596920.924309:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789596920.924316:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14378:x1876527964855296:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789596920.924394:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14378:x1876527964855296:12345-0@lo:1000:mdt00_001.0 Request processed in 77us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596920.924400:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789596920.925708:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa253100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14378:1876527964855296:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789596920.926630:0:14378:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1789596920.926714:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8fa253100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14378:1876527964855424:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789596920.926785:0:14378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789596920.929974:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c313da80 going to sleep for 11 seconds 00000100:00100000:3.0:1789596920.938899:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964855424 00000100:00100000:3.0:1789596920.938933:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964855424 00000100:00100000:3.0:1789596920.939010:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789596920.939020:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14378:x1876527964855424:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789596920.939329:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14378:x1876527964855424:12345-0@lo:1000:mdt00_001.0 Request processed in 310us (12543us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789596920.939336:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789596920.940023:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8fa253100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14378:1876527964855424:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789596920.940080:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afc00/0x8973ae90b38d8fd7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.940090:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afc00/0x8973ae90b38d8fd7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.940111:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afc00/0x8973ae90b38d8fd7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.940116:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8fe9afc00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596920.940121:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afc00/0x8973ae90b38d8fd7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.940128:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afc00/0x8973ae90b38d8fd7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.940145:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:0.0:1789596920.940148:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789596920.940153:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afc00/0x8973ae90b38d8fd7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.940159:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afc00/0x8973ae90b38d8fd7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.940197:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8f36 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.940203:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8f36 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.940208:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8f36 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.940213:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ef427c00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:0.0:1789596920.940215:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8f36 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.940229:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8f36 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.940237:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ea8e0eeab00) 00010000:00010000:0.0:1789596920.940240:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789596920.940246:0:14378:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d8f3d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34525c expref: 18 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.940256:0:14378:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d8f3d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34525c expref: 18 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.940265:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d8f3d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34525c expref: 18 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.940601:0:14378:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8c0030800/0x8973ae90b38d8f3d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c34525c expref: 18 pid: 14378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596920.940618:0:14378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6570700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14378:1876527964855552:192.168.202.44@tcp:105: 00000100:00100000:0.0:1789596920.940703:0:14378:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6f08e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789596920.943674:0:14378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6570700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14378:1876527964855552:192.168.202.44@tcp:105: 00010000:00010000:2.0:1789596920.943705:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8f36 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.943716:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8ef427c00/0x8973ae90b38d8f36 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14379 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.943749:0:14378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afe00/0x8973ae90b38d8fde lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.943762:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afe00/0x8973ae90b38d8fde lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.943773:0:14378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afe00/0x8973ae90b38d8fde lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.943784:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afe00/0x8973ae90b38d8fde lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.943791:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afe00/0x8973ae90b38d8fde lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.943813:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afe00/0x8973ae90b38d8fde lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.943845:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8fe9afe00 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596920.943862:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afe00/0x8973ae90b38d8fde lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.943871:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afe00/0x8973ae90b38d8fde lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.943882:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ea8e0eeab00) 00010000:00010000:2.0:1789596920.943885:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789596920.943888:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afe00/0x8973ae90b38d8fde lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.943895:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9afe00/0x8973ae90b38d8fde lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.943911:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af600/0x8973ae90b38d8fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.943917:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af600/0x8973ae90b38d8fd0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.943924:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af600/0x8973ae90b38d8fd0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.943929:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8fe9af600 already unused, calling callback (ffffffffc203e4f0) 00010000:00010000:2.0:1789596920.943932:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af600/0x8973ae90b38d8fd0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.943938:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af600/0x8973ae90b38d8fd0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.943944:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ea8e0eeab00) 00010000:00010000:2.0:1789596920.943947:0:14378:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789596920.943953:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af600/0x8973ae90b38d8fd0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.943960:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af600/0x8973ae90b38d8fd0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14378 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596920.944311:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa65a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+18:14478:x1876527944953088:12345-192.168.202.44@tcp:57:lhsmtool_posix.0 Request processed in 42623us (47172us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789596920.944321:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 53 00000020:00080000:2.0:1789596920.944327:0:14378:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789596920.945584:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596920.946569:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944953344 00000100:00100000:0.0:1789596920.946586:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944953344 00000100:00100000:0.0:1789596920.946648:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 10 00000100:00100000:0.0:1789596920.946659:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8ef53e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+18:14477:x1876527944953344:12345-192.168.202.44@tcp:49:dd.0 00000100:00100000:0.0:1789596920.946836:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8ef53e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+18:14477:x1876527944953344:12345-192.168.202.44@tcp:49:dd.0 Request processed in 178us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596920.946844:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 10 00000100:00100000:0.0:1789596920.951921:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596920.952106:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944953600 00000100:00100000:2.0:1789596920.952118:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944953600 00000100:00100000:2.0:1789596920.952180:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 11 00000100:00100000:2.0:1789596920.952191:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+18:14478:x1876527944953600:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789596920.952900:0:14380:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789596920.953003:0:14380:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1789596920.953047:0:14380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af800/0x8973ae90b38d8fe5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.953063:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af800/0x8973ae90b38d8fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.953087:0:14380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af800/0x8973ae90b38d8fe5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.953096:0:14380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af800/0x8973ae90b38d8fe5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.953103:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af800/0x8973ae90b38d8fe5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.953109:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af800/0x8973ae90b38d8fe5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596920.953135:0:14380:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789596920.953221:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+20:14478:x1876527944953600:12345-192.168.202.44@tcp:35:lhsmtool_posix.0 Request processed in 1030us (1309us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789596920.953229:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 11 00000020:00080000:2.0:1789596920.953235:0:14380:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789596920.953967:0:14365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789596920.953977:0:14365:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af800/0x8973ae90b38d8fe5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.953986:0:14365:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8fe9af800 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:0.0:1789596920.954000:0:14365:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af800/0x8973ae90b38d8fe5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.954009:0:14365:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af800/0x8973ae90b38d8fe5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.954022:0:14365:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ea8e0eea200) 00010000:00010000:0.0:1789596920.954026:0:14365:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789596920.954030:0:14365:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af800/0x8973ae90b38d8fe5 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.954037:0:14365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ea8fe9af800/0x8973ae90b38d8fe5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596920.954057:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596920.954059:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789596920.954061:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789596920.955379:0:14409:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789596920.955387:0:14409:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789596920.955423:0:14409:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789596920.955429:0:14409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1789596921.179254:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596921.209593:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596921.209639:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596921.209671:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596921.209776:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944953856 00000100:00100000:0.0:1789596921.209786:0:15067:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944953856 00000100:00100000:0.0:1789596921.209856:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944953728 00000100:00100000:0.0:1789596921.209859:0:15067:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944953728 00000100:00100000:0.0:1789596921.209870:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944953984 00000100:00100000:0.0:1789596921.209872:0:15067:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944953984 00000100:00100000:0.0:1789596921.209887:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 0 00000100:00100000:0.0:1789596921.209897:0:15067:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+10:2353:x1876527944953856:12345-192.168.202.44@tcp:4:dd.0 00010000:00010000:0.0:1789596921.209945:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f43b95c6/0x8973ae90b38d8fec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596921.209966:0:15067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000ef869c1/0x8973ae90b38d8fbb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345286 expref: 10 pid: 16253 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596921.209976:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789596921.209980:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596921.209985:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f43b95c6/0x8973ae90b38d8fec lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596921.210030:0:15067:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000ef869c1/0x8973ae90b38d8fbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345286 expref: 10 pid: 16253 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596921.210045:0:15067:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000ef869c1/0x8973ae90b38d8fbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345286 expref: 10 pid: 16253 timeout: 606 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596921.210060:0:15067:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f6571180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:15067:1876527964855680:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789596921.210169:0:15067:0:(client.c:2716:ptlrpc_set_wait()) set ffff9ea8c6f08300 going to sleep for 11 seconds 00000100:00100000:0.0:1789596921.213358:0:15067:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f6571180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:15067:1876527964855680:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789596921.213392:0:15067:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f43b95c6/0x8973ae90b38d8fec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596921.219910:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596921.220189:0:16492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944954112 00000100:00100000:0.0:1789596921.220199:0:16492:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944954112 00010000:00010000:0.0:1789596921.220251:0:16492:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000ef869c1/0x8973ae90b38d8fbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345286 expref: 11 pid: 16253 timeout: 606 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789596921.220295:0:16492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 14 00000100:00100000:0.0:1789596921.220304:0:16492:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa250700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+11:2353:x1876527944954112:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789596921.220319:0:16492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789596921.220354:0:16492:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000ef869c1/0x8973ae90b38d8fbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345286 expref: 11 pid: 16253 timeout: 606 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596921.220369:0:16492:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000ef869c1/0x8973ae90b38d8fbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345286 expref: 11 pid: 16253 timeout: 606 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596921.220392:0:16492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ef869c1/0x8973ae90b38d8fbb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0x2dd2b3a02c345286 expref: 11 pid: 16253 timeout: 606 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596921.220410:0:16492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596921.220414:0:16492:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596921.220420:0:16492:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f43b95c6/0x8973ae90b38d8fec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596921.220429:0:16492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f43b95c6/0x8973ae90b38d8fec lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596921.220473:0:16492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789596921.220519:0:16492:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa250700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+10:2353:x1876527944954112:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 216us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789596921.220535:0:16492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 14 00010000:00010000:1.0:1789596921.220608:0:15067:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f43b95c6/0x8973ae90b38d8fec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596921.220619:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f43b95c6/0x8973ae90b38d8fec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789596921.347033:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:3.0:1789596921.347055:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:3.0:1789596921.347076:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:2.0:1789596921.347315:0:15067:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1789596921.347320:0:15067:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789596919 -> 1789596920 00002000:00010000:2.0:1789596921.347324:0:15067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1789596921.347341:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f43b95c6/0x8973ae90b38d8fec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.347356:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f43b95c6/0x8973ae90b38d8fec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.347366:0:15067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f43b95c6/0x8973ae90b38d8fec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.347373:0:15067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031600 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596921.347378:0:15067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f43b95c6/0x8973ae90b38d8fec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.347388:0:15067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f43b95c6/0x8973ae90b38d8fec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.347424:0:15067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f43b95c6/0x8973ae90b38d8fec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.347432:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f43b95c6/0x8973ae90b38d8fec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596921.347643:0:15067:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+7:2353:x1876527944953856:12345-192.168.202.44@tcp:4:dd.0 Request processed in 137742us (138054us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1789596921.347657:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 0 00000100:00100000:2.0:1789596921.347686:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1 00000100:00100000:2.0:1789596921.347697:0:15067:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:2354:x1876527944953728:12345-192.168.202.44@tcp:4:dd.0 00002000:00010000:2.0:1789596921.347734:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6aab14f8, atime: 0x6aab14f7, ctime: 0x0, blocks: 0x807 00010000:00010000:2.0:1789596921.347740:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fdc52cc/0x8973ae90b38d8ff3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.347752:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1789596921.347756:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596921.347763:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fdc52cc/0x8973ae90b38d8ff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.347775:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fdc52cc/0x8973ae90b38d8ff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789596921.405805:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:3.0:1789596921.405974:0:15067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:3.0:1789596921.405991:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fdc52cc/0x8973ae90b38d8ff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.406006:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fdc52cc/0x8973ae90b38d8ff3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.406015:0:15067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fdc52cc/0x8973ae90b38d8ff3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.406097:0:15067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8fe9afe00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:3.0:1789596921.406104:0:15067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fdc52cc/0x8973ae90b38d8ff3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.406114:0:15067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fdc52cc/0x8973ae90b38d8ff3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.406135:0:15067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fdc52cc/0x8973ae90b38d8ff3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.406159:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fdc52cc/0x8973ae90b38d8ff3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596921.406268:0:15067:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:2354:x1876527944953728:12345-192.168.202.44@tcp:4:dd.0 Request processed in 58570us (196623us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789596921.406282:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1 00000100:00100000:3.0:1789596921.406312:0:15067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2 00000100:00100000:3.0:1789596921.406324:0:15067:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:2353:x1876527944953984:12345-192.168.202.44@tcp:4:dd.0 00002000:00010000:3.0:1789596921.406358:0:15067:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6aab14f8, atime: 0x6aab14f7, ctime: 0x0, blocks: 0x1007 00010000:00010000:3.0:1789596921.406363:0:15067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8ffa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.406373:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1789596921.406378:0:15067:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596921.406383:0:15067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8ffa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.406395:0:15067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8ffa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789596921.452877:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:3.0:1789596921.453083:0:15067:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:3.0:1789596921.453089:0:15067:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1789596921.453104:0:15067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8ffa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.453139:0:15067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8ffa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.453149:0:15067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8ffa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.453157:0:15067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7e00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:3.0:1789596921.453162:0:15067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8ffa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.453172:0:15067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8ffa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.453192:0:15067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8ffa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.453200:0:15067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d8ffa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596921.453301:0:15067:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:2353:x1876527944953984:12345-192.168.202.44@tcp:4:dd.0 Request processed in 46975us (243623us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789596921.453311:0:15067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2 00000100:00100000:3.0:1789596921.459981:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789596921.460018:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596921.462169:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944954240 00000100:00100000:2.0:1789596921.462184:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944954240 00000100:00100000:2.0:1789596921.462326:0:15068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944954368 00000100:00100000:2.0:1789596921.462330:0:15068:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944954368 00000100:00100000:2.0:1789596921.462354:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 3 00000100:00100000:2.0:1789596921.462363:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+6:2354:x1876527944954240:12345-192.168.202.44@tcp:4:dd.0 00002000:00010000:2.0:1789596921.462409:0:15068:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aab14f8, atime: 0x6aab14f7, ctime: 0x0, blocks: 0x1807 00010000:00010000:2.0:1789596921.462420:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f360624f/0x8973ae90b38d9001 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.462436:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1789596921.462441:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596921.462448:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f360624f/0x8973ae90b38d9001 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.462462:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f360624f/0x8973ae90b38d9001 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596921.464249:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596921.465239:0:15067:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789596921.465257:0:15067:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789596921.465371:0:15067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944954496 00000100:00100000:0.0:1789596921.465383:0:15067:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944954496 00000100:00100000:0.0:1789596921.465844:0:16611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 4 00000100:00100000:0.0:1789596921.465857:0:16611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+8:2354:x1876527944954368:12345-192.168.202.44@tcp:4:dd.0 00010000:00010000:0.0:1789596921.465891:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a03b20a2/0x8973ae90b38d9008 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596921.465907:0:16611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596921.465911:0:16611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789596921.465917:0:16611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a03b20a2/0x8973ae90b38d9008 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789596921.465930:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a03b20a2/0x8973ae90b38d9008 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596921.474403:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596921.474456:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789596921.474556:0:15067:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789596921.474569:0:15067:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1789596921.474955:0:15066:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1789596921.474970:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944954624 00000100:00100000:1.0:1789596921.474980:0:15066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944954624 00000100:00100000:1.0:1789596921.475036:0:15066:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1789596921.475041:0:15066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944954752 00000100:00100000:1.0:1789596921.475044:0:15066:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944954752 00000100:00100000:1.0:1789596921.476097:0:16612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 5 00000100:00100000:1.0:1789596921.476112:0:16612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46d2bae8-7b02-42fb-8d03-bd9a4d260687+11:2353:x1876527944954496:12345-192.168.202.44@tcp:4:dd.0 00010000:00010000:1.0:1789596921.476149:0:16612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cccb0c2/0x8973ae90b38d900f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596921.476167:0:16612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596921.476172:0:16612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789596921.476179:0:16612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cccb0c2/0x8973ae90b38d900f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789596921.476194:0:16612:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cccb0c2/0x8973ae90b38d900f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789596921.561381:0:15068:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:3.0:1789596921.561402:0:15068:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789596920 -> 1789596921 00002000:00010000:3.0:1789596921.561405:0:15068:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1789596921 00002000:00010000:3.0:1789596921.561408:0:15068:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1789596921.561425:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f360624f/0x8973ae90b38d9001 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.561440:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f360624f/0x8973ae90b38d9001 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.561451:0:15068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f360624f/0x8973ae90b38d9001 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.561459:0:15068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8fe9ae200 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:3.0:1789596921.561478:0:15068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f360624f/0x8973ae90b38d9001 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.561488:0:15068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f360624f/0x8973ae90b38d9001 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.561510:0:15068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f360624f/0x8973ae90b38d9001 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.561519:0:15068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f360624f/0x8973ae90b38d9001 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596921.561620:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+17:2354:x1876527944954240:12345-192.168.202.44@tcp:4:dd.0 Request processed in 99253us (101644us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789596921.561639:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 3 00000100:00100000:3.0:1789596921.561670:0:15068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 6 00000100:00100000:3.0:1789596921.561683:0:15068:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+16:2354:x1876527944954624:12345-192.168.202.44@tcp:4:dd.0 00010000:00010000:3.0:1789596921.561713:0:15068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d9016 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.561727:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596921.561731:0:15068:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789596921.561739:0:15068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d9016 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.561752:0:15068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d9016 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789596921.570600:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:2.0:1789596921.607147:0:16611:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:2.0:1789596921.607157:0:16611:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:2.0:1789596921.607174:0:16611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a03b20a2/0x8973ae90b38d9008 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.607188:0:16611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a03b20a2/0x8973ae90b38d9008 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.607198:0:16611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a03b20a2/0x8973ae90b38d9008 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.607219:0:16611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8c0031400 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596921.607224:0:16611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a03b20a2/0x8973ae90b38d9008 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.607234:0:16611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a03b20a2/0x8973ae90b38d9008 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.607254:0:16611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a03b20a2/0x8973ae90b38d9008 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.607262:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a03b20a2/0x8973ae90b38d9008 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596921.607342:0:16611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f67c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+16:2354:x1876527944954368:12345-192.168.202.44@tcp:4:dd.0 Request processed in 141484us (147319us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1789596921.607352:0:16611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 4 00000100:00100000:2.0:1789596921.607380:0:16611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 7 00000100:00100000:2.0:1789596921.607390:0:16611:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+15:2354:x1876527944954752:12345-192.168.202.44@tcp:4:dd.0 00010000:00010000:2.0:1789596921.607417:0:16611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ab76f79/0x8973ae90b38d901d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.607430:0:16611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596921.607434:0:16611:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789596921.607440:0:16611:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ab76f79/0x8973ae90b38d901d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.607465:0:16611:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ab76f79/0x8973ae90b38d901d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789596921.613728:0:16612:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1789596921.613750:0:16612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cccb0c2/0x8973ae90b38d900f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.613765:0:16612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009cccb0c2/0x8973ae90b38d900f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.613776:0:16612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009cccb0c2/0x8973ae90b38d900f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.613784:0:16612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea9021f8400 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:3.0:1789596921.613789:0:16612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009cccb0c2/0x8973ae90b38d900f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.613807:0:16612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009cccb0c2/0x8973ae90b38d900f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.613855:0:16612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009cccb0c2/0x8973ae90b38d900f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.613863:0:16612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cccb0c2/0x8973ae90b38d900f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596921.613950:0:16612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46d2bae8-7b02-42fb-8d03-bd9a4d260687+15:2353:x1876527944954496:12345-192.168.202.44@tcp:4:dd.0 Request processed in 137837us (149703us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789596921.613960:0:16612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 5 00000001:00080000:3.0:1789596921.617368:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00000001:00080000:1.0:1789596921.644639:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:3.0:1789596921.647108:0:15068:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1789596921.647119:0:15068:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1789596921.647134:0:15068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d9016 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.647147:0:15068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d9016 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.647155:0:15068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d9016 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.647161:0:15068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8ff4e7e00 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:3.0:1789596921.647175:0:15068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d9016 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.647185:0:15068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d9016 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.647206:0:15068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d9016 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789596921.647213:0:15068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059594f51/0x8973ae90b38d9016 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789596921.647314:0:15068:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+9:2354:x1876527944954624:12345-192.168.202.44@tcp:4:dd.0 Request processed in 85630us (172915us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789596921.647324:0:15068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 6 00010000:00010000:2.0:1789596921.687692:0:16611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ab76f79/0x8973ae90b38d901d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.687713:0:16611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ab76f79/0x8973ae90b38d901d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.687723:0:16611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ab76f79/0x8973ae90b38d901d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.687730:0:16611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ea8fe9ae000 already unused, calling callback (ffffffffc15e18b0) 00010000:00010000:2.0:1789596921.687735:0:16611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ab76f79/0x8973ae90b38d901d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.687745:0:16611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ab76f79/0x8973ae90b38d901d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.687763:0:16611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ab76f79/0x8973ae90b38d901d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789596921.687771:0:16611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ab76f79/0x8973ae90b38d901d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789596921.687913:0:16611:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:46d2bae8-7b02-42fb-8d03-bd9a4d260687+7:2354:x1876527944954752:12345-192.168.202.44@tcp:4:dd.0 Request processed in 80520us (213451us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789596921.687932:0:16611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 7 00000001:00080000:0.0:1789596921.691209:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00000100:00100000:1.0:1789596921.883202:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789596921.883226:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9ea8f67c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964855808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789596921.883296:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789596921.884132:0:15064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527964855808 00000100:00100000:3.0:1789596921.884144:0:15064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527964855808 00000100:00100000:3.0:1789596921.884207:0:15064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789596921.884217:0:15064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8c37a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964855808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789596921.884243:0:15064:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3859808256 avail 3849322496 00000100:00100000:3.0:1789596921.884311:0:15064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8c37a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876527964855808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789596921.884318:0:15064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789596921.884407:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1789596921.884413:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ea8c37a8a80, transno 8589934595 00000004:00080000:1.0:1789596921.884433:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1789596921.884472:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9ea8f67c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876527964855808:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789596922.203233:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789596923.236572:0:14366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789596923.240360:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596923.240409:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596923.240436:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596923.240458:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596923.240480:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596923.240498:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596923.240520:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789596923.240545:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944955136 00000100:00100000:2.0:1789596923.240555:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944955136 00000100:00100000:2.0:1789596923.240608:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944955648 00000100:00100000:2.0:1789596923.240611:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944955648 00000100:00100000:2.0:1789596923.240624:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944955264 00000100:00100000:2.0:1789596923.240627:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944955264 00000100:00100000:2.0:1789596923.240636:0:15063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944955520 00000100:00100000:2.0:1789596923.240637:0:15063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944955520 00000100:00100000:2.0:1789596923.240647:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 18 00000100:00100000:2.0:1789596923.240654:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:2351:x1876527944955136:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596923.240714:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:2351:x1876527944955136:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 60us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596923.240719:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 18 00000100:00100000:2.0:1789596923.240732:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 19 00000100:00100000:2.0:1789596923.240736:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+5:2351:x1876527944955648:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596923.240749:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+5:2351:x1876527944955648:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 14us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596923.240753:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 19 00000100:00100000:2.0:1789596923.240767:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 20 00000100:00100000:2.0:1789596923.240770:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6526680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:2351:x1876527944955264:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596923.240784:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6526680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46d2bae8-7b02-42fb-8d03-bd9a4d260687+5:2351:x1876527944955264:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 14us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596923.240787:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 20 00000100:00100000:2.0:1789596923.240793:0:15063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 21 00000100:00100000:2.0:1789596923.240796:0:15063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8f6526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+5:2351:x1876527944955520:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596923.240807:0:15063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8f6526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+5:2351:x1876527944955520:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 11us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596923.240810:0:15063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 21 00000100:00100000:2.0:1789596923.240849:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944955392 00000100:00100000:2.0:1789596923.240852:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944955392 00000100:00100000:2.0:1789596923.240871:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944955008 00000100:00100000:2.0:1789596923.240873:0:14377:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944955008 00000100:00100000:2.0:1789596923.240883:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 28 00000100:00100000:2.0:1789596923.240887:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+6:2351:x1876527944955392:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596923.240906:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2f7ae9ce-878f-4910-aaa3-2f42ff41aa04+6:2351:x1876527944955392:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 19us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596923.240910:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 28 00000100:00100000:2.0:1789596923.240918:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 29 00000100:00100000:2.0:1789596923.240921:0:14377:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea8fa253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+20:2351:x1876527944955008:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789596923.240934:0:14377:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea8fa253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46d2bae8-7b02-42fb-8d03-bd9a4d260687+20:2351:x1876527944955008:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 12us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789596923.240937:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 29 00000100:00080000:2.0:1789596923.240961:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789596923.240965:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789596923.240966:0:14373:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789596923.241234:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876527944954880 00000100:00100000:1.0:1789596923.241238:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876527944954880 00000100:00100000:1.0:1789596923.241267:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 121 00000100:00100000:1.0:1789596923.241273:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9ea900451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:2351:x1876527944954880:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789596923.241296:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9ea900451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92037e76-77c7-46ec-bc5c-4b7881dcad9b+13:2351:x1876527944954880:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 24us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789596923.241309:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 121 00000001:02000400:1.0:1789596923.438291:0:16649:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1789596924.251376:0:14365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29128 lines, 29128 kept, 0 dropped, 0 bad.